-- Logs begin at Tue 2022-05-17 17:25:04 UTC, end at Tue 2022-05-17 18:34:21 UTC. -- May 17 17:57:57.206883 dv-cinder-841302-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 17 17:57:57.214623 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 17 17:57:57 2022] *** May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: nodename: dv-cinder-841302-3-iscsi May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: machine: x86_64 May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: clock source: unix May 17 17:57:57.216612 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: pcre jit disabled May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: detected number of CPU cores: 4 May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: current working directory: / May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: detected binary path: /usr/bin/uwsgi-core May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: your processes number limit is 47680 May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: your memory page size is 4096 bytes May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: detected max file descriptor number: 2048 May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: lock engine: pthread robust mutexes May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: thunder lock: enabled May 17 17:57:57.217014 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 17 17:57:57.217459 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 17 17:57:57.263969 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: Python main interpreter initialized at 0x561cbaa509c0 May 17 17:57:57.263969 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: python threads support enabled May 17 17:57:57.263969 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: your server socket listen backlog is limited to 100 connections May 17 17:57:57.263969 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: your mercy for graceful operations on workers is 90 seconds May 17 17:57:57.264340 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: mapped 403077 bytes (393 KB) for 2 cores May 17 17:57:57.264404 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: *** Operational MODE: preforking *** May 17 17:57:57.264694 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: *** uWSGI is running in multiple interpreter mode *** May 17 17:57:57.264694 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: spawned uWSGI master process (pid: 79954) May 17 17:57:57.264899 dv-cinder-841302-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 17 17:57:57.267453 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: spawned uWSGI worker 1 (pid: 79967, cores: 1) May 17 17:57:57.267453 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: spawned uWSGI worker 2 (pid: 79968, cores: 1) May 17 17:57:57.268942 dv-cinder-841302-3-iscsi devstack@keystone.service[79954]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 17 17:58:02.985480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:58:02.985480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: from cryptography.utils import int_from_bytes May 17 17:58:02.986887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:58:02.986887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: from cryptography.utils import int_from_bytes May 17 17:58:02.990258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:58:02.990258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: from cryptography.utils import int_from_bytes May 17 17:58:02.991655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 17 17:58:02.991655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: from cryptography.utils import int_from_bytes May 17 17:58:03.036307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:58:03.036483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:58:03.036712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] command line args: [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:58:03.036945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:58:03.037124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ================================================================================ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:58:03.037377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] admin_token = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.037624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_dir = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.037810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.037983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 17 17:58:03.038073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] config_source = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.038145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] debug = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.038210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 17 17:58:03.038374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.040734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] command line args: [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 17 17:58:03.040734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 17 17:58:03.040734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ================================================================================ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 17 17:58:03.040924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.040991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] admin_token = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_dir = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] config_source = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] debug = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_config_append = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_dir = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.041937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_config_append = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_dir = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.042959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.043949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.044913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.045148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.045317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.045507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] publish_errors = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.045703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.045934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.046888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.047255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.047449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] standard_threads = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.047672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] publish_errors = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.047874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.048931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_journal = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.049287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.049478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_json = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.049637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.049769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_stderr = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.049769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] use_syslog = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] standard_threads = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.050618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.050883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.051084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_journal = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.051222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.051356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_json = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.051356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_stderr = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.051603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.051730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] use_syslog = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.051863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.051989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 17 17:58:03.052120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.052922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.053899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.054981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.055894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.056955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057475 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.057865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.058820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059443 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.059896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.060993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.061927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.062075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.062231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.062713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.062849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.062974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.063934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.064070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.064196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.065396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.065396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.065750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.065975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.066175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.066339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.066529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.066791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.066980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.067207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.067371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.067623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.067829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.068969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.069157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.069346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.069568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.070347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.070612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.070791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.070955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.071984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.072930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.073876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.074971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.075880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.076937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.077844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.078967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.079895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.080963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.081984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.082921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.external = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.083966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.external = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.password = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] auth.token = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.084915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.085055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.password = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.085183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.085310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] auth.token = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.086906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.087041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.087169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.087313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.087443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.087573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.088650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.088736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.088804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.088883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.088948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.089946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.090967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091094 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.091976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.092983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.093937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.094926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.095937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.096993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.097976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.098496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.100712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.100811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.100879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.100950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.101986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.102956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103836 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.103996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.104977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.105904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.106966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.107997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.108792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.110766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.110925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.110925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.111905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.112871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.113856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.114891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.115997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.116134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.116280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.116428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.116567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.116728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.117325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.117472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.117610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.117757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.117899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.118914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.119878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.120858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.121972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.122980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.123972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.124973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.125962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.126925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.127899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79968) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.128517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.129644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 17 17:58:03.129644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79967) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 17 17:58:03.155638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.155936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.156110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.156462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.156698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.156909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.164851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.165739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.194602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.194602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.201619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.201746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.251268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.251872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.302844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.303081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.303941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.304827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.370947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.371163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.371244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.371565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.371880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.372192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.372504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.394425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.394687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.394917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.395866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.396185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.396496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.396804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.397123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.407831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.408996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.423114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.423463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.423783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.424100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.424413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.424734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.425045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79968) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.425454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.425685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.425906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.426122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.426341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.426553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.426788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79967) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 17 17:58:03.443261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.443396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.443548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 17:58:03.443779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 17:58:03.443865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.444065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 17:58:03.444330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.444411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.444586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.444870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 17 17:58:03.444961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.445296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.445481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.445836 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.446192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.446544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.455989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.456265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.456532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.456812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.458785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.459163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.459529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.459905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.465387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.468654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.468743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.468936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.469213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.469600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.469880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.470138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.470422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.470690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.470958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.471224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.471483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.473014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.473409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.473788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.474267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.474736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.475096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.475464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.475834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.476884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.477290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.477658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.498319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.499965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.500243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.505155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.505509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.505784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.506062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.507189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.507715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.513059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.513365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.513509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.513636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.513850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.518206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.518484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.518785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.519063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.519334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.519601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.519864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.520124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.521701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.522048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.527368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.527722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.528068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.528414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.528754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.529091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.529425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.529757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.539385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.539654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.544131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.547767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.548056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.549785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.550138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.553033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.555605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.557498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.559506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.559879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.561307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.561607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.561887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.562168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.562732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.563011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.565668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.569371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.573486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.573856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.574206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.574555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.574912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.575251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.582408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.582848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.583118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.583381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.592045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.593798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.594070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.596246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.596724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.597059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.597187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.597412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.597540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.597690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.597975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.610679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.610791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.610791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.610791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.610791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.610791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.611278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.611357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.611607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.611741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.611940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.612217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.612502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.612778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.613045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.613320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.625696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.625974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.626248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.626532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.626838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.627119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.627392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.631288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.635108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.638377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.639984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.641608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.641903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.642186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.645656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.649469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.650091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.651709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.652767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.654349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.654952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.655240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.655516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.655784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.656100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.656374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.656659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.664555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.665056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.665347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.665626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.666130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.669318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.669601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.669878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.670145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.673476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79967) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.673756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.674031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.674309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.674610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.674888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.675157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.675426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.675687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.675947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.676221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.676493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.676759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.677013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79967) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.679417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.679702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.679975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.688137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79968) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 17 17:58:03.688419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.688736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.689018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.689285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.689570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.689922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.690213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.690556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.692845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.693148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.693453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.693770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.694044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79968) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 17 17:58:03.716410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cbaa509c0 pid: 79967 (default app) May 17 17:58:03.719720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e490-ff46-4b34-9501-bb3303906068 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:03.720015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e490-ff46-4b34-9501-bb3303906068 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:03.720298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62e490-ff46-4b34-9501-bb3303906068 None None] PATH_INFO: `/v3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:03.727599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue May 17 17:58:03 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:03.734090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cbaa509c0 pid: 79968 (default app) May 17 17:58:11.646977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:11.647564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:11.647564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:11.649392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 2/2] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:11.656739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:11.657158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:11.657302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:11.689099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG oslo_db.sqlalchemy.engines [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79968) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:58:11.871301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG passlib.handlers.bcrypt [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79968) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 17:58:11.871726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG passlib.handlers.bcrypt [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79968) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 17:58:11.927870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:11.930032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:12.058681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1/3] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 17:58:12.185590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:12.220288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG oslo_db.sqlalchemy.engines [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79967) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 17 17:58:12.349329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1940ab16-ef50-4c34-b514-017e501d7ffa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:12.354102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:12.354789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:12.355077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:12.355355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:12.363339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:12.416282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING keystone.common.rbac_enforcer.enforcer [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 17:58:12.416622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965e2449-089c-41ee-aee8-46672245e4c0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:12.426128 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 3/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue May 17 17:58:12 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 17:58:12.432614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:12.448050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b6538-cf6d-4f85-936b-dfd3ff54c9b3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:12.452390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:12.453512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:12.453800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:12.454086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] PATH_INFO: `/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:12.455619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce77dde206fe428ba1cf2d3583c7c4a2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:12.505688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING keystone.common.rbac_enforcer.enforcer [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 17 17:58:12.506036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356114df-5fe5-4cbe-878f-75d03047ca75 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:12.511295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 2/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue May 17 17:58:12 2022] GET /identity/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:14.709900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f007b-7c73-455e-a698-1d0ea0528dc0 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:14.710489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f007b-7c73-455e-a698-1d0ea0528dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:14.710602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f007b-7c73-455e-a698-1d0ea0528dc0 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:14.714650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 4/6] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:14.720022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:14.720412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:14.720582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:14.740072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:14.742109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:14.749819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 3/7] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:14 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 17 17:58:14.772044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f007b-7c73-455e-a698-1d0ea0528dc0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:14.783809 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f007b-7c73-455e-a698-1d0ea0528dc0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:14.787958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23561156-402d-4841-b840-55381943107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:14.788717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561156-402d-4841-b840-55381943107f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:14.789024 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561156-402d-4841-b840-55381943107f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:14.789301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23561156-402d-4841-b840-55381943107f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:14.796718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23561156-402d-4841-b840-55381943107f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:14.798483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23561156-402d-4841-b840-55381943107f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:14.807657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 5/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue May 17 17:58:14 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 17:58:14.813082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:14.822411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841151a-a6e0-4e95-bbf3-b5b89dba26f2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:14.826727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:14.827576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:14.827854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:14.828123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:14.829492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:14.831335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e877c2e-301d-4fe1-a0a3-5396581b4cd2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:14.832883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 4/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue May 17 17:58:14 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:17.124456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053ed2a-d90b-4ce7-80aa-94c93805e007 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.125006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053ed2a-d90b-4ce7-80aa-94c93805e007 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.125006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053ed2a-d90b-4ce7-80aa-94c93805e007 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.126363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 6/10] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:17.130935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838702c-96e4-49f0-9a6a-d4c4eb2300e5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.131363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838702c-96e4-49f0-9a6a-d4c4eb2300e5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.131494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838702c-96e4-49f0-9a6a-d4c4eb2300e5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.131583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.131784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.132668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.133371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 5/11] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:17.138179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.138468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.138777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.176438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG passlib.handlers.bcrypt [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=79967) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 17 17:58:17.176778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG passlib.handlers.bcrypt [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79967) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 17 17:58:17.227279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:17.228926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:17.263196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:17.264390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:17.342092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 7/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:17.342313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:17.364570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.365078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.458697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb085e0-2885-4a4b-ae07-0369af8e2797 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.463370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db094833-b179-48c3-9f89-dd78f4be0b6c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.490140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.490977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.491770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.492067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.496454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.497351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.497636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.497915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.502688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:17.514263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:17.515494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:17.516527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 7/13] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:17.521217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.566209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:17.567748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:17.617692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9ace9c-235e-4d48-ad48-9fe75b63701e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.649837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.650496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.650808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.651085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.651833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:17.652140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:17.653525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:17.659502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 8/14] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:58:17.664904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:17.665124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.670089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.771635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6d4db-411f-420f-89d8-1f105b6be47c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.806804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.807678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.807960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.808239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.809444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:17.811013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:17.812824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 9/16] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:17.818225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.866312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3987a-4f39-40c6-a90d-3f94634200e2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.898870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.899666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.899945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.900216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.909846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f55380-077d-49c7-a36d-761e5a106417 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:17.918679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:17.921361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:58:17.941161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:17.942002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:17.947740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:58:17.947740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:58:17.947740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:58:17.947740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:17.947740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:17.948020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:17.948020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:17.948020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:17.948020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:17.948273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:17.948273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:17.948402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:17.949257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:17.954405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:18.045234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb603b2-ea58-42ca-be16-bf76dad56b64 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:18.050919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827366b-f474-41e8-a6db-c84bf9fa706d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:18.077207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:18.077869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:18.078153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:18.078426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:18.079200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:18.079504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:18.080875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f95f8f-a600-4cde-a673-599c17c26c30 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:18.084350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:18.085010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:18.085295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:18.085721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:18.086628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.domain.id=default, user.id=019f8abbfcaf48d98532c6915b54e5c0) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:18.086950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:18.088369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124a43c-ef8e-44ae-81f8-d1bb28a71abc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:18.095000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 11/19] 10.222.0.25 () {56 vars in 1322 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/role_assignments?user.id=019f8abbfcaf48d98532c6915b54e5c0&scope.domain.id=default&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 233 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:18.097409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:20.724935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2115c-6ece-43ae-82e3-42ab3c326126 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:20.725453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2115c-6ece-43ae-82e3-42ab3c326126 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:20.725672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2115c-6ece-43ae-82e3-42ab3c326126 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:20.727035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:20.745645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358628-9870-446c-bc2b-de9ee4fc8f18 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:20.746149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358628-9870-446c-bc2b-de9ee4fc8f18 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:20.746222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358628-9870-446c-bc2b-de9ee4fc8f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:20.772606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-db358628-9870-446c-bc2b-de9ee4fc8f18 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:20.774140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-db358628-9870-446c-bc2b-de9ee4fc8f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:20.854089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:20.869402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe5d5-2a09-43df-9185-537fba42fb2b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:20.869950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe5d5-2a09-43df-9185-537fba42fb2b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:20.870449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe5d5-2a09-43df-9185-537fba42fb2b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:20.872031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:20.877708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:20.878302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:20.878814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:20.901683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe5d5-2a09-43df-9185-537fba42fb2b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:20.905451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:20.906905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:21.038206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe5d5-2a09-43df-9185-537fba42fb2b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.066211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:21.074986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.076064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.076527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.076977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.087829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:21.095733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:21.096582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:21.097358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:21.099418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 14/26] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:21.106313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.111809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.286813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90421d9a-40e8-498a-a9c5-9e613f2deeb8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.316359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bad9a80-bcb8-490d-95d2-d07e688990d4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.344675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.345720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.346142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.346607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.360638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.369046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:21.391299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.392139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.392522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.392895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.393770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:21.394175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.395696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f908e6-1557-4847-b9c3-e5ced1c08da7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5ce59019-4500-49ad-9382-fa09cc285a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:58:21.398199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:21.399058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:21.399950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:58:21.399950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:58:21.399950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:58:21.399950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:21.401560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 15/27] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:21.408165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3bc0-2367-4c0e-8a2b-20581ff6a01a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.408690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3bc0-2367-4c0e-8a2b-20581ff6a01a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.409137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f3bc0-2367-4c0e-8a2b-20581ff6a01a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.410618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 16/28] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:21.411463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3bc0-2367-4c0e-8a2b-20581ff6a01a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.417892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 13/29] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:21.425787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.426322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.426792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.463349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:21.464836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:21.532674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 14/30] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:21.533777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.536518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f3bc0-2367-4c0e-8a2b-20581ff6a01a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.572146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.572834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.573191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.573537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.574356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:21.574759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.576233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06187beb-dd34-4237-a314-75a45b646bf3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:21.594069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 17/31] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:21.595725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c900c-13b8-4c2b-8fe7-630065acc7b3 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.596228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c900c-13b8-4c2b-8fe7-630065acc7b3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.596709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c900c-13b8-4c2b-8fe7-630065acc7b3 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.598154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 18/32] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:21.599080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c900c-13b8-4c2b-8fe7-630065acc7b3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.653192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9d5d3-663e-427f-9a23-eb5a98108d51 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.693246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.694910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.695345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.695846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.697551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.699282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab16e56-eb3e-4ed9-a8cd-994c424333b6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:21.701488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 15/33] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:21 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:21.702931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.703362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.703756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.706597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c900c-13b8-4c2b-8fe7-630065acc7b3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.721285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:21.722740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:21.741982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.742848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.743232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.743608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.744459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.746400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:21.802769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 16/34] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:21.804374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.902033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 19/35] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 17 17:58:21 2022] POST /identity/v3/roles => generated 225 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:21.903295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:21.922114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bbe300-320e-451c-b0f6-084ec8a94e3c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:21.959512 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:21.962017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:21.962398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:21.962831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:21.963670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:21.965241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.018273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d6678-4418-45c7-9cf5-0a87124f5472 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:22.058314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:22.059526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.059979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.060388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.061818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:22.063886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.066179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 20/36] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:22.067233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:22.181025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 17/37] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 17:58:21 2022] POST /identity/v3/projects => generated 301 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:22.184672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:22.237895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6c90-7526-4a32-8840-2e780c075118 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:22.290738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:22.291442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.291730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.292522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.293614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:22.295711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3226f-6432-41e9-818c-285f6dff4af2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.324908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 21/38] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 17 17:58:22 2022] POST /identity/v3/roles => generated 219 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:22.330596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39772-fc54-4a4d-8bc4-3c8035809a89 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.330596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39772-fc54-4a4d-8bc4-3c8035809a89 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.330596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d39772-fc54-4a4d-8bc4-3c8035809a89 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.330596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 22/39] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:22.336015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.338006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.338289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.381311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:22.383664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:22.386754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a0b64-8519-4fb6-827e-3ab8e5cb2485 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:22.462945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:22.463771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.464113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.464946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] PATH_INFO: `/v3/domains/default/users/019f8abbfcaf48d98532c6915b54e5c0/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.467837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=019f8abbfcaf48d98532c6915b54e5c0, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:22.470564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce0665a-c03c-4ced-b5b1-abf42b001b50 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.487935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 23/40] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:22.495907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 18/41] 10.222.0.25 () {58 vars in 1361 bytes} [Tue May 17 17:58:22 2022] PUT /identity/v3/domains/default/users/019f8abbfcaf48d98532c6915b54e5c0/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:22.520402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:22.599841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518b97-eed0-4b4a-b4b8-768bc24f5332 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.600157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518b97-eed0-4b4a-b4b8-768bc24f5332 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.600411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9518b97-eed0-4b4a-b4b8-768bc24f5332 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.602628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 19/42] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:22.611668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.612045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.612406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.637150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:22.639027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:22.644422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604cb2f-f819-414c-b278-ab36c6a14ca6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:22.693041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:22.693737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.694176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.694888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.696413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:22.697380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.713820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 24/43] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 17 17:58:22 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:22.733304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 20/44] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:22.757490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:22.863343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b3b68a-bb89-416b-a210-8128ba6003b6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:22.902372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:22.902372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:22.902814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:22.902814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:22.904888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:22.905471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46df9e3-5091-4637-9da1-7842db2ff432 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:22.907317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 25/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:22.912597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:23.020323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01838e4-7bc6-4dfb-9c64-ea5e119e731e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:23.052124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:23.052791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:23.053075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:23.053352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:23.054661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:23.056119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc127c3-5c80-4896-902b-ab09d316503d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:23.080606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 21/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 17:58:22 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:24.802314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6bbe-8989-4457-94fe-cfc7e49a8f31 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:24.802864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6bbe-8989-4457-94fe-cfc7e49a8f31 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:24.802971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814c6bbe-8989-4457-94fe-cfc7e49a8f31 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:24.804299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 26/47] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:24.809668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:24.810096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:24.810353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:24.828314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:24.829481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:24.892073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 22/48] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:24.915730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c6bbe-8989-4457-94fe-cfc7e49a8f31 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.015726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814c6bbe-8989-4457-94fe-cfc7e49a8f31 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.053494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.054860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.055071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.055348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.065396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:25.073583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:25.074721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:25.080700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 27/49] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:25.081332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.180887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a932830-f6c3-4124-85f1-973893a182dc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.213126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.213793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.214075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.214348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.215120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:25.215424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.216787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82d2ef2-bf85-463c-96e8-d4c3ceee67e8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.224611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 23/50] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:25.230183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.297918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409dc8b-902d-4c6d-b587-a3f62bf545de None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.298204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409dc8b-902d-4c6d-b587-a3f62bf545de None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.298482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409dc8b-902d-4c6d-b587-a3f62bf545de None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.299892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 24/51] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:25.306016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.306258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.306542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.323848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:25.325027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:25.326330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c97c311-dc02-4fb9-b57c-bab1f891a80a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.358760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f788-cc13-4d15-a999-193013766130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.359634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f788-cc13-4d15-a999-193013766130 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.359922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f788-cc13-4d15-a999-193013766130 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.360202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167f788-cc13-4d15-a999-193013766130 None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.361388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f788-cc13-4d15-a999-193013766130 None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.362863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167f788-cc13-4d15-a999-193013766130 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.364493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 28/52] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:25 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:25.370420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f788-cc13-4d15-a999-193013766130 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.389778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 25/53] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:25.412432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.462585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167f788-cc13-4d15-a999-193013766130 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.494945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.495734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.496020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.496293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.497474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.498935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.500527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 29/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:25.506110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.508192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24868a-a516-4e07-b4c6-05383bd784cf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.540780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.541569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.541858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.542139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.543360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.544817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.546417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 26/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:25.551907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:25.598213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e0a8a-5327-4796-b86b-f966706f0e16 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.630865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.631527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.631883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.632164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.633003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.domain.id=default, user.id=019f8abbfcaf48d98532c6915b54e5c0) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:25.633320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.634789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f18240-a19c-4ca6-8596-d692b4ce44e1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.640438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 30/56] 10.222.0.25 () {56 vars in 1322 bytes} [Tue May 17 17:58:25 2022] GET /identity/v3/role_assignments?user.id=019f8abbfcaf48d98532c6915b54e5c0&scope.domain.id=default&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 530 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:25.644499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7502fd0-5d5e-410a-b2b8-29cf779908fc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:25.680850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:25.681539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:25.681821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:25.682093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:25.682890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:25.684378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cb4ef7-f70a-4276-9bf8-96c99807cc0e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:25.711628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 27/57] 10.222.0.25 () {60 vars in 1140 bytes} [Tue May 17 17:58:25 2022] POST /identity/v3/projects => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:58:27.935457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cd49-3a0f-4395-92d9-646b6f31d527 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:27.935853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cd49-3a0f-4395-92d9-646b6f31d527 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:27.936023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c506cd49-3a0f-4395-92d9-646b6f31d527 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:27.937410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 31/58] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:27.942869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:27.943298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:27.943431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:27.962002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:27.963215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:28.024806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 28/59] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:28.048947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506cd49-3a0f-4395-92d9-646b6f31d527 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:28.143186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c506cd49-3a0f-4395-92d9-646b6f31d527 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:28.175187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:28.175916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:28.176198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:28.176474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:28.177643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:28.179338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a330144-8139-4e50-a9b6-777bb1b26410 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:28.180940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 32/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:28.186368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:28.278645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1143daf-5115-43a1-8466-86b4c75015ff None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:28.310482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:28.311172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:28.311454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:28.311727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:28.312435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:28.314121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1b10f-b141-4e14-a807-7e422d701eff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:28.338030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 29/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:28 2022] POST /identity/v3/users => generated 275 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:58:31.782593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287953ad-d99b-434c-b3e9-18b53cfa50d2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:31.784122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287953ad-d99b-434c-b3e9-18b53cfa50d2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:31.784888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287953ad-d99b-434c-b3e9-18b53cfa50d2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:31.788005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 33/62] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:31.794281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:31.795001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:31.795261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:31.836936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:31.839277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:31.891137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf191-3c47-487a-8eeb-33c44a73418f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:31.892034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf191-3c47-487a-8eeb-33c44a73418f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:31.892831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851bf191-3c47-487a-8eeb-33c44a73418f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:31.897900 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 34/63] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:31.905480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:31.905480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:31.905480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:31.951602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:31.952803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:31.962264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 30/64] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:31.987368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.119423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b93e2b-34b4-4c8c-945a-eba8f5bcf60c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.132348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 35/65] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:32.159308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.161295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.162146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.162431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.163251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.180968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:32.190073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:32.191991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:32.193617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:32.198614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 31/66] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:32.206408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.367042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9ca89b-6464-43ab-ac5c-cb457ea2c6fc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.403674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efec61d1-1e4e-402d-8499-c889b2bcba41 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.434792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.436123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.436627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.437118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.444598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.445333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.445595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.445933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.446715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:32.447020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:32.448461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c5ef4d-4c26-4fa5-962e-da28b4c7a663 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:32.455310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:32.456918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 32/67] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:32.458151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7efb-021d-496b-8524-13a430a7e0dd None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.458416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7efb-021d-496b-8524-13a430a7e0dd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.462844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f7efb-021d-496b-8524-13a430a7e0dd None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.464383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 33/68] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:32.466195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7efb-021d-496b-8524-13a430a7e0dd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f18130f1-d9b4-4f4a-a3d7-14d40a347f72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:32.471682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:32.472580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:32.473347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:32.474072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 36/69] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:32.476539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.477053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.477539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.505016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:32.507335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:32.587250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 37/70] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:32.595737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.603360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f7efb-021d-496b-8524-13a430a7e0dd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.640269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.641147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.641418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.641693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.656934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:32.658323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc09a51-9854-44df-8127-e23587e5a5ee None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:32.660237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 34/71] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:32.661442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da123-7fbe-47f2-8819-95e058d68770 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.661736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da123-7fbe-47f2-8819-95e058d68770 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.662013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348da123-7fbe-47f2-8819-95e058d68770 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.663616 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 35/72] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:32.664288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348da123-7fbe-47f2-8819-95e058d68770 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.709174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17837e02-5213-458a-a92b-d80614d30c7a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.743745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.744426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.744729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.744994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.745751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:32.746059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:32.747491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:32.755669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 38/73] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:32.756389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.768547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348da123-7fbe-47f2-8819-95e058d68770 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.800310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.801124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.801406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.801683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.812137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-15e855d4-c56b-4f12-a9b6-f4d028a58da2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:32.821169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:32.822141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:32.823131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 36/74] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:32.823941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.823941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.824088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.839602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:32.840788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:32.852064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960a82f-1beb-4d4d-aaa1-f293b7208448 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:32.883345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:32.883992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:32.884274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:32.884547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:32.902974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 37/75] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:32.903890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:32.949887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:32.951368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.003860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d958c25a-384e-4a71-8530-615e90a24d33 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.036495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.037595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.038510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.038820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.040010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.041448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb7c08-4629-4fb6-b014-6c7f8ccc4f79 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.043307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 38/76] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.043424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:33.043989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.044257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8461-b374-4a05-8df2-4f1622fa438d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.044541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8461-b374-4a05-8df2-4f1622fa438d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.044815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f8461-b374-4a05-8df2-4f1622fa438d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.046041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 39/78] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:33.046757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8461-b374-4a05-8df2-4f1622fa438d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.142417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f8461-b374-4a05-8df2-4f1622fa438d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.147724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4e68a9-8ef8-4dd8-9ce1-f486d1877dac None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.175330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.176050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.176331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.176600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.177747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.179892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.180313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.180988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.181277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.186265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 40/79] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.186400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.186593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.186672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:33.186672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.186672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205dcde-6e55-4e2e-aee0-2ff458d7b338 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.192294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 40/80] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.193389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.193681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.193963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.209302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:33.211060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:33.272938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 41/81] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:33.273865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.275229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b1af-77b1-44cc-9637-5a201a8da2b6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.307784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.308449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.308733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.309009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.366447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f684eb2-2979-4d90-bc6c-8dbd4cbec52e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.371976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.373431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.398036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.398934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.399228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.399502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.400693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.402140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.403957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 42/82] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.404606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.470639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 41/83] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:33.471476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.498290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413390af-96b7-42b9-968a-35457d9f99e0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.529770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.530437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.530758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.531037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.531749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.533183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.558345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 43/84] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:33 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:33.559201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.563553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aca5b3-7d7c-4cd5-857f-bcd71999b58d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.600058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.601916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.602245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.602537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.603878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.605419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.612017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 42/85] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.612017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.664713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc50dbb-a346-4519-9319-41bcfac3176d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.699951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.701232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.701729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.702073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.713417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:33.713644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d605c-d54c-4e12-99bb-a341b4d6fec4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:33.721401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:33.722342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 44/86] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:33.723501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.749672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.750333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.750639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.751877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.752715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:33.753503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.754443 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.763091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 43/87] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.763931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.832936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2e609-905e-49fb-92df-9ee948105266 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.871076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.871964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.872065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0dea86-d915-432b-a7ba-b84e699b4201 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:33.872406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.872498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:33.878869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:33.880415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:33.882870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 45/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:33.883768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:33.915326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:33.916123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:33.916407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:33.916684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.014944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d114e210-c036-4aea-8dd6-26024f015311 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.019628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.021441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.053836 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.054533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.054908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.055117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.055865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:34.056176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.057873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.069768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 46/89] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:34.070653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.136941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 44/90] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:34.137643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.192491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3663685e-c4d1-4d54-a0b5-fcbdd271b946 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.235174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.236444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.237077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.237549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.239100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=019f8abbfcaf48d98532c6915b54e5c0) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:34.239589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.242528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.246970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dec244-22d2-4efd-adc2-d5f626d9915b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.250516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 47/91] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/role_assignments?user.id=019f8abbfcaf48d98532c6915b54e5c0&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:34.251509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.338193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.339121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.339407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.339780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.347590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.349108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.351704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 45/92] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:34.365406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.453770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85bc288-43b9-47aa-8752-2a48d8ce62c3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.505461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.506381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.507408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.507691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.508896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.510522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.512625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 48/93] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:34.519483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.587346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6c070c-6248-42e3-80e5-0c7547eab078 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.649804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4579e96-210d-4959-8ec6-c2722ea11dec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:34.669643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.670301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.670596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.670869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.706880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:34.707544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:34.707824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:34.708097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:34.708919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:34.709225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.712324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.723553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=6aada032643443b8a7ee169eadfab258 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:34.769717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:34.771290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:34.878168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:58:34.884028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:34.991582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfca1f-ec53-4ddc-961c-06f68f640e44 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:35.028305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c79597-4178-408d-9693-001540b26606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:35.029232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79597-4178-408d-9693-001540b26606 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:35.029556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79597-4178-408d-9693-001540b26606 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:35.029844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c79597-4178-408d-9693-001540b26606 None admin] PATH_INFO: `/v3/projects/4f0d0792a619498c9955aaa32edfd52b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:35.031088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c79597-4178-408d-9693-001540b26606 None admin] RBAC: Authorizing `identity:get_project(project_id=4f0d0792a619498c9955aaa32edfd52b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:35.032532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c79597-4178-408d-9693-001540b26606 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:35.034220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:34 2022] GET /identity/v3/projects/4f0d0792a619498c9955aaa32edfd52b => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:35.041068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:35.154803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73c618-8601-46a0-a6bc-56275d318787 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:35.196685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:35.197353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:35.197635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:35.197909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:35.198768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=4f0d0792a619498c9955aaa32edfd52b, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:35.199076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:35.200494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37480648-eb82-4dea-a515-bcd5badb4605 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:35.206109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:35 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=4f0d0792a619498c9955aaa32edfd52b&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:36.692476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5494f-018c-48d5-8784-7cf8298f5a3c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:36.693491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5494f-018c-48d5-8784-7cf8298f5a3c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:36.694497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5494f-018c-48d5-8784-7cf8298f5a3c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:36.696363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:36.702193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:36.703066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:36.703534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:36.721234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:36.722721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:36.802739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:36.820660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5494f-018c-48d5-8784-7cf8298f5a3c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:36.932100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5494f-018c-48d5-8784-7cf8298f5a3c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:36.978132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:36.978895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:36.979180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:36.979458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:36.993984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5f203391-ebd9-48bb-9d14-95a9373b999d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:37.001820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:37.002735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:37.003541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:37.007955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 52/100] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:37.009343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.121172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df32a6-fd63-4b65-8311-e26ffe490285 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:37.155179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea665-f1ad-43e3-9483-8c7695d91a60 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.155504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea665-f1ad-43e3-9483-8c7695d91a60 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.155754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ea665-f1ad-43e3-9483-8c7695d91a60 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.157143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 53/101] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:37.162244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.162686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.164030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.185763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:37.186776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.187066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.187344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.188369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:37.188677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:37.189382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:37.190069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:37.191011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:37.203804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:37.205877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.326314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc4dab-ad6c-4b58-a56d-3f4751238b23 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:37.365297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:37.366469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.366792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.367075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] PATH_INFO: `/v3/users/9bf2a4b9fd354f4caf7010c05996af81` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.382865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf2a4b9fd354f4caf7010c05996af81)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:37.384437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:37.386165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/users/9bf2a4b9fd354f4caf7010c05996af81 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:37.387526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 54/104] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:37.392130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.419256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.511526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c698c-17ee-4280-9af2-624ba9907104 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:37.551461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:37.552130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.552418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.552758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.630025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:37.632491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d027e5a-a854-4372-b828-a773d13955ce None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:37.672512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf8fdb-3683-4728-8dee-66d9040c7229 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:37.722718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:37.723878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.724224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.724513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.725737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:37.728150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56cc614-4308-41a6-a88c-7a8fb54575c0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:37.730769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 55/105] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:37.732316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b03ea-22f2-4a01-872e-9714dfc94d5e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.732910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b03ea-22f2-4a01-872e-9714dfc94d5e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.733212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b03ea-22f2-4a01-872e-9714dfc94d5e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.735293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 56/106] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:37.737146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2206c-e445-422e-9bb6-3a727ccb40b0 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.737437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2206c-e445-422e-9bb6-3a727ccb40b0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.737713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2206c-e445-422e-9bb6-3a727ccb40b0 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.738994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 57/107] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:37.739546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 51/108] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:37.744110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2206c-e445-422e-9bb6-3a727ccb40b0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.745342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e71f-df94-4c64-97e5-2b98d43b85cf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.745637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e71f-df94-4c64-97e5-2b98d43b85cf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.745913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708e71f-df94-4c64-97e5-2b98d43b85cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.763978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e708e71f-df94-4c64-97e5-2b98d43b85cf None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:37.765167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e708e71f-df94-4c64-97e5-2b98d43b85cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:37.832921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 52/109] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:37.834207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.834528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.842967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.870167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2206c-e445-422e-9bb6-3a727ccb40b0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:37.871941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:37.873131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:37.913407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:37.914675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:37.914969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:37.915256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:37.916364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:37.921557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:37.951827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 53/110] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:37.953118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:37.958093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 58/111] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 17:58:37 2022] POST /identity/v3/projects => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:37.959388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.072991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aa717a-3f57-4b3b-82be-08b980c68058 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.091174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64455da8-3583-49f3-b54d-1bed74420d81 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.110929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.112160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.112676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.113153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.125037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:38.128845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.129886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.130191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.130470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.132018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.133681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.135508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 54/112] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:38.136240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:38.137087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:38.137910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:38.138557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.144720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 59/113] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:38.144720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.282965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62302515-02b3-4dde-8f82-b46601040286 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.315605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ba300-1af7-42ce-ae0d-0c0357489afe None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.323458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.324526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.324814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.325090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.339215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:38.348233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:38.349219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:38.350012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 55/114] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:38.355524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.365659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.367387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.367678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.367954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.368800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=9bf2a4b9fd354f4caf7010c05996af81) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:38.369118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.370648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e800e-2502-421c-b84b-11df0cc3b42a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.380256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 60/115] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/role_assignments?user.id=9bf2a4b9fd354f4caf7010c05996af81&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.387934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040302-8b8f-4cf4-acd5-5185402795c4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.388602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040302-8b8f-4cf4-acd5-5185402795c4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.388602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74040302-8b8f-4cf4-acd5-5185402795c4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.390934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 61/116] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:38 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:38.393340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040302-8b8f-4cf4-acd5-5185402795c4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.533823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04ded0-286e-436d-b2dc-0966b55f2bcc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.570075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.570800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.571084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.571469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.572242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:38.572554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.573054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74040302-8b8f-4cf4-acd5-5185402795c4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.574031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf9c989-2a2b-450c-a6d4-0b6e0def125c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.583789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 56/117] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.585935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.586063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.586310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.608418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:38.609756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:38.612329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.613017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.613299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.613577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.614338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:38.614656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.616644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408eb65e-dc88-4f73-8c0b-cc8b95ce53c1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.627208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 62/118] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.633667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4f87-8b29-4e8f-9ee5-c3e9c0e3732c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.633963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4f87-8b29-4e8f-9ee5-c3e9c0e3732c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.634270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03e4f87-8b29-4e8f-9ee5-c3e9c0e3732c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.635750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 63/119] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:38.636485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4f87-8b29-4e8f-9ee5-c3e9c0e3732c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.702911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 57/120] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:38.703888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.745527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03e4f87-8b29-4e8f-9ee5-c3e9c0e3732c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.781885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.783164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.783644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.784165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.785601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.787303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715eab7f-ffd0-4315-8539-45e72888579c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.789250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 64/121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.790720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.791211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.791722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.802993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5eb4a-d222-4615-b688-222048b76685 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.810090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:38.812170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:38.838537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.839546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.839832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.840109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:38.841293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:38.842807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:38.844497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 58/122] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:38.845286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.883052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 65/123] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:38.884220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:38.952715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8c9d0-25a6-486a-ae39-bdd15395e553 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.992991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fef49-5b11-4106-8d12-1e8a5b26bb7b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:38.997204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:38.998268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:38.998802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:38.999298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.010690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:39.020513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:39.021414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:39.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:39.025461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 59/124] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:39.026695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.027718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.030174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.030458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.030768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.032458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.036081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.036081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 66/125] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:38 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.036538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.135328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5badb56-490b-4de9-b37c-928b387de747 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.136747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b081334a-b131-41aa-96e9-612bd7fe5bb9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.172929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c082-18a1-499a-abea-a4159718184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.174324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c082-18a1-499a-abea-a4159718184f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.174871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c082-18a1-499a-abea-a4159718184f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.175415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401c082-18a1-499a-abea-a4159718184f None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.176447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.177069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c082-18a1-499a-abea-a4159718184f None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.177451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.177828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.178292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.179419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401c082-18a1-499a-abea-a4159718184f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.181341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 60/126] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.182250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c082-18a1-499a-abea-a4159718184f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.194828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:39.202977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:39.203912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:39.204754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 67/127] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:39.205439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.287362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401c082-18a1-499a-abea-a4159718184f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.304396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d33d9-61e7-4775-a61f-3b84f9e1d53a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.323686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.324668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.325103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.325527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.326422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:39.326911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.328453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.338501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 61/128] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.339645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.343855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.344799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.345181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.345603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/users/02019db97dca48f884e39de75c42c568/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.347845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, user_id=02019db97dca48f884e39de75c42c568, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.349944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.371698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 68/129] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:39 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/users/02019db97dca48f884e39de75c42c568/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:39.372818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.470777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db57211-eb94-4485-bd88-4d8154fd7eca None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.519428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcc2f9-4de8-47c6-85ba-429024b57fec None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.545055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.546212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.548186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.548639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/users/019f8abbfcaf48d98532c6915b54e5c0/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.552536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, user_id=019f8abbfcaf48d98532c6915b54e5c0, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.554832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.582888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 62/130] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:39 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/users/019f8abbfcaf48d98532c6915b54e5c0/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:39.583983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.599802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.600987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.601431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.601874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.602832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:39.605407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.607064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.618807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 69/131] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.628064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.713839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6d4f10-9483-427e-8e16-be2bbe3f564b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.748395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.749435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.749622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.749904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.751887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.753357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.753799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001028d-1df6-4816-92d8-869e2fd956b7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.755232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 63/132] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.761265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.800571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.801713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.802157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.802596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.804228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.806012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.807996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 70/133] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:39.843223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:39.878755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d29372-c117-4ec3-a99c-21d5d1c994e1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:39.915152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:39.916052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:39.916346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:39.916617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] PATH_INFO: `/v3/projects/4f0d0792a619498c9955aaa32edfd52b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:39.917891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] RBAC: Authorizing `identity:get_project(project_id=4f0d0792a619498c9955aaa32edfd52b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:39.922675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:39.922675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 64/134] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/projects/4f0d0792a619498c9955aaa32edfd52b => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:39.934891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:40.039758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611bff74-67a0-4975-89fe-0a8069a35aab None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:40.108307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:40.109117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:40.109404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:40.109680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:40.114071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:40.115557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:40.119147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 71/135] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:39 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:40.134875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ea032-7954-4de7-b2ba-62ff4938f686 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:40.137383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:40.197597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:40.198559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:40.198912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:40.199191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] PATH_INFO: `/v3/projects/4f0d0792a619498c9955aaa32edfd52b/users/02019db97dca48f884e39de75c42c568/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:40.202526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] RBAC: Authorizing `identity:create_grant(project_id=4f0d0792a619498c9955aaa32edfd52b, user_id=02019db97dca48f884e39de75c42c568, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:40.204008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585f5f-2789-447f-af9e-6ab89ab6ae80 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:40.232362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 65/136] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:39 2022] PUT /identity/v3/projects/4f0d0792a619498c9955aaa32edfd52b/users/02019db97dca48f884e39de75c42c568/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:58:40.284755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ddb6-9686-4d3b-9a4b-b29b9f00998e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:40.331475 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:40.332383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:40.332666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:40.332944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/users/02019db97dca48f884e39de75c42c568/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:40.336973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, user_id=02019db97dca48f884e39de75c42c568, role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:40.338437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a1de0d-ca25-4c3c-8479-ace7db359dab None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:40.365070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 72/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:40 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/users/02019db97dca48f884e39de75c42c568/roles/6aada032643443b8a7ee169eadfab258 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:58:40.761075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fa12-e6c7-4c01-90d4-0390fb7f5efc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:40.761442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fa12-e6c7-4c01-90d4-0390fb7f5efc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:40.761645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452fa12-e6c7-4c01-90d4-0390fb7f5efc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:40.763259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 66/138] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:40.776685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:40.777188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:40.777263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:40.798844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:40.800096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:40.879000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 73/139] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:40.921481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452fa12-e6c7-4c01-90d4-0390fb7f5efc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:41.051225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452fa12-e6c7-4c01-90d4-0390fb7f5efc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:41.097053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:41.097882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:41.098166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:41.098442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:41.099666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:41.101735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf5ce18-0029-43ec-beb7-4db35acb7821 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:41.103829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 67/140] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:41.108921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:41.233277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f1838-ea96-485b-af0b-38a9bb4b04e9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:41.267583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:41.268265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:41.268547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:41.268820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:41.269527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:41.270995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bba0061-84b5-4d8c-91e7-e1d7ba7c0f3d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:41.300177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 74/141] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:41 2022] POST /identity/v3/users => generated 283 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:41.559051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa867c0-3dcb-4dc8-bf10-9523f3d88a37 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:41.559458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa867c0-3dcb-4dc8-bf10-9523f3d88a37 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:41.559633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa867c0-3dcb-4dc8-bf10-9523f3d88a37 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:41.561372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 68/142] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:41.566881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:41.567173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:41.567450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:41.591843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:41.593049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:41.681128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 75/143] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:41.724467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa867c0-3dcb-4dc8-bf10-9523f3d88a37 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:41.840943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa867c0-3dcb-4dc8-bf10-9523f3d88a37 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:41.875492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:41.876297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:41.876579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:41.876853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:41.887852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:41.895764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:41.898542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:41.899413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 69/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:41.903408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:42.027016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b8545-44b8-40c1-b1fd-853249393ca3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:42.073776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:42.074561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.074811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.075096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.076477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:42.076798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:42.078223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:42.091885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 76/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:42.097762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:42.241605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70b279-2ce8-40cf-8084-270973a895d8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:42.287491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:42.288540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.288823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.289101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] PATH_INFO: `/v3/users/9bf2a4b9fd354f4caf7010c05996af81` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.290358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=9bf2a4b9fd354f4caf7010c05996af81)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:42.291848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:42.293816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 70/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:42 2022] GET /identity/v3/users/9bf2a4b9fd354f4caf7010c05996af81 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:42.299748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:42.455418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adeb53-5703-41f8-a811-bfd41f041488 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:42.498946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:42.499898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.500184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.500464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.501793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:42.503401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6dd03-b947-4bf5-9b6b-c3db5791c51d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:42.505676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 77/147] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:42 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:42.512976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:42.793767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498b6b55-bb72-4333-bfa0-9b7b0ec3a9c9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:42.879342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:42.880181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09359-1b97-45c7-aae3-250d96fd35e2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.880312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.880477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09359-1b97-45c7-aae3-250d96fd35e2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.880566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.880760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed09359-1b97-45c7-aae3-250d96fd35e2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.880861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/users/9bf2a4b9fd354f4caf7010c05996af81/roles/f13bb00fd3294f6db01aa3e7df4326c8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.882184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 78/148] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:42.883157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, user_id=9bf2a4b9fd354f4caf7010c05996af81, role_id=f13bb00fd3294f6db01aa3e7df4326c8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:42.884602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:42.896555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:42.896913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:42.897190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:42.906813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 71/149] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:42 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/users/9bf2a4b9fd354f4caf7010c05996af81/roles/f13bb00fd3294f6db01aa3e7df4326c8 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:42.939499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:42.940718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:43.070537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 79/150] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:43.101871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:43.217156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aafa8f-0177-4554-9ef5-1c38b9543a81 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:43.253918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:43.254762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:43.255051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:43.255394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:43.266925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:43.275566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:43.276478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:43.277259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 72/151] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:43.283015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:43.387314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165026-668a-4be1-ab18-6b41c0eb680d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:43.422729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:43.423416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:43.423694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:43.423971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:43.424726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:43.425032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:43.426416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:43.435325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 80/152] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:43.441330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:43.550044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231696d4-08eb-44e8-9bbf-21eece8d1e26 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:43.586105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:43.587023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:43.587312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:43.587591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:43.588802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:43.590269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:43.592222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 73/153] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:43 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:43.597708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:43.699060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9ac3d-e1a2-43d9-9510-35e713fd52cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:43.732543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:43.733208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:43.733490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:43.738594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:43.802727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:43.805017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc663987-6ccc-4d9f-960f-350f02b08406 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:43.904989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 81/154] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:43.910504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.002968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa79e-cbe8-43d3-a36e-52f34f2f2a97 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.003446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa79e-cbe8-43d3-a36e-52f34f2f2a97 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.003446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fa79e-cbe8-43d3-a36e-52f34f2f2a97 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.004818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 82/155] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:44.010614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.010912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.011205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.038906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ccb61-b2bb-4b8c-8dfc-d9473c8a57de None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.041700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:44.042942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:44.117087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.118607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.118607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.118607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.123319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:44.124776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:44.126515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 74/156] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:43 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:44.148898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.200634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 83/157] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:44.257329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.299069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd57bc6-0522-4f25-b499-06da8088d54a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.379329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.380347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.380863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.381894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.383143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:44.383668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:44.385289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dd045-63ac-4236-9177-5ebc25ca7f67 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:44.398065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 75/158] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:44.410059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48cd99-5d6c-46b8-852c-ebd2c51c327f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.450699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.451513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.451795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.452071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.460189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b23fc-b376-43d8-a00c-9aa4f47c672a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.460786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b23fc-b376-43d8-a00c-9aa4f47c672a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.461273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b23fc-b376-43d8-a00c-9aa4f47c672a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.464518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:44.465622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 76/159] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:44.471288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:44.472168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:44.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 84/160] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:44.474207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.475037 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.475562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.480588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.495169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:44.496721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:44.572046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 77/161] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:44.599345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d1273-52d5-402e-9364-440f15c6ce21 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.603578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.657201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.658035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.658437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.658819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.659779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:44.660274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:44.661863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa2235-9aee-4150-83c2-33dd6e740f0a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:44.678826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 85/162] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:44.680650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b7ab-6b5a-48df-89a5-4496f7b579bc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.681200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b7ab-6b5a-48df-89a5-4496f7b579bc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.681666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52b7ab-6b5a-48df-89a5-4496f7b579bc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.683132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 86/163] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:44.689071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.689674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.690149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.719682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:44.721239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:44.724054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aefa23-03d3-4db1-b9f8-aa8233220db4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.763727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.765272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.765712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.766159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.778607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:44.787833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:44.789281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:44.790264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:44.793209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 78/164] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:44.794304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.862314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 87/165] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:44.863466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.919788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdc956-dafc-4980-99e7-5c73ec68e52a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:44.962717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:44.963847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:44.964261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:44.964660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] PATH_INFO: `/v3/users/019f8abbfcaf48d98532c6915b54e5c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:44.966060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] RBAC: Authorizing `identity:get_user(user_id=019f8abbfcaf48d98532c6915b54e5c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:44.967696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:44.969829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 79/166] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/users/019f8abbfcaf48d98532c6915b54e5c0 => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:44.976123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:44.991364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83665410-afd8-421b-b3bc-38e7d6b8158a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.055150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.056367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.056650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.056919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.057665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:45.057971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:45.060167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:45.076306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 88/167] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:45.078948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:45.159939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434636b-2f59-4546-8e14-23ebc2f3b0dc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.228166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.229258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.229678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.230089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.249990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:45.260948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:45.262010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:45.262845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:45.264894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 80/168] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:45.265823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:45.273547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1428f5-3358-4058-b4a0-dc232cd50772 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.328158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.328985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.329365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.329740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.430615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:45.432200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:45.567467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc001f0-3c65-42ad-a05e-87202981b42b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.619386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 89/169] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:45.620247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:45.639339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.640238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.640523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.640795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.642031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:45.643530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:45.646042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 81/170] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:45.647493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:45.878295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1f02d2-dd88-438d-8e0c-e1519404d21d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.878664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01337fbf-3f76-43c8-9ef6-b630524be14a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:45.961605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.962527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.966912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.967359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.974589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:45.974589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:45.974777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:45.974777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:45.974777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:45.974777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:45.975093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:45.975093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:45.975093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:45.976491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 82/171] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:45.977281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:45.989608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 90/172] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:45.990987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.136739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95e600-4f6f-4b13-b070-af61eee1e49e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.164973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54f35e5-1d3d-47df-97e1-8f07e593ca05 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.187273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.188863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.189366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.189840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.217288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=019f8abbfcaf48d98532c6915b54e5c0) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.233962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 91/173] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/role_assignments?user.id=019f8abbfcaf48d98532c6915b54e5c0&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:46.233962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.306850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.309054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.401702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d317bf-e9b0-4491-948e-7020e0054524 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.438300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.439233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.439517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.439795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] PATH_INFO: `/v3/users/02019db97dca48f884e39de75c42c568` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.446600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] RBAC: Authorizing `identity:get_user(user_id=02019db97dca48f884e39de75c42c568)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.446600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.446600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 92/174] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:46 2022] GET /identity/v3/users/02019db97dca48f884e39de75c42c568 => generated 275 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:46.450863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.452897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 83/175] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:46.459072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.567789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0831cc6-cab4-4cab-9989-dac8f2fed280 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.606756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.607426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.607706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.607978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.680763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d20b30-7ce7-4403-9712-93ff273af9e8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.683637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.685132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1bf404-a359-4c36-bc73-9dd572eabeb8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.720816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.722026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.722507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.722985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] PATH_INFO: `/v3/projects/4f0d0792a619498c9955aaa32edfd52b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.724404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] RBAC: Authorizing `identity:get_project(project_id=4f0d0792a619498c9955aaa32edfd52b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.726096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5354ce-3d34-4364-822a-79b7f03fee3f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.727971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 84/176] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:46 2022] GET /identity/v3/projects/4f0d0792a619498c9955aaa32edfd52b => generated 312 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:46.729302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd7fc1-cfb5-4171-91db-b444778203c0 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.729697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd7fc1-cfb5-4171-91db-b444778203c0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.730070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd7fc1-cfb5-4171-91db-b444778203c0 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.731451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 85/177] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:46.733137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba687-2a1c-4fb1-a4ed-701e33cd5d72 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.733137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba687-2a1c-4fb1-a4ed-701e33cd5d72 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.733350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aba687-2a1c-4fb1-a4ed-701e33cd5d72 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.738653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 86/178] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:46.739470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba687-2a1c-4fb1-a4ed-701e33cd5d72 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.799698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 93/179] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:46.801123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af2f4-4596-4431-9af2-34f368a81e35 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.801413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af2f4-4596-4431-9af2-34f368a81e35 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.801687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8af2f4-4596-4431-9af2-34f368a81e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.820116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ea8af2f4-4596-4431-9af2-34f368a81e35 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:46.821296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ea8af2f4-4596-4431-9af2-34f368a81e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:46.847952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aba687-2a1c-4fb1-a4ed-701e33cd5d72 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:46.883443 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:46.884569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.885097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.885574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.886639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=4f0d0792a619498c9955aaa32edfd52b, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:46.887190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:46.888892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:46.890972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 94/180] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:46.896023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 87/181] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:46 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=4f0d0792a619498c9955aaa32edfd52b&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:46.897133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:46.900097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:46.900317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:46.900541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:46.939970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:46.940781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:47.011286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d9a52-272b-41f3-b75d-c5edcfb80f9e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.017254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:47.018130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.049965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.051297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.051810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.052304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.054422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.056294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.058312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 88/183] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:46 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.064493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.149497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318fbdf-88a4-4ee1-9d9e-778daa3880ca None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.176417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f33da-a4fb-483c-b7e4-6c9fe704dea9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.192412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.193188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.193468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.194299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.215736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.216301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:47.217359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.217849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.218375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.219469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=02019db97dca48f884e39de75c42c568) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:47.219991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.221656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:47.228225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:47.229194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:47.229998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 96/184] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:47.230688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.233740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 89/185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/role_assignments?user.id=02019db97dca48f884e39de75c42c568&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=6aada032643443b8a7ee169eadfab258 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.235178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.379425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87b20c-95a8-4cf2-a545-aeee33940e1d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.391529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659a209-ec56-40e7-8901-93ca989d923b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.419793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.420845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.421359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.421837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.422878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:47.423334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.424891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d03e82e-f86f-469d-9beb-667b6120f682 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.434282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 90/186] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:47.435961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dee-604c-4a8d-af16-aa91242fa4ba None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.436391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dee-604c-4a8d-af16-aa91242fa4ba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.436806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99dee-604c-4a8d-af16-aa91242fa4ba None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.437677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.438760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 91/187] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:47.439127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.439384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.439773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.440317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99dee-604c-4a8d-af16-aa91242fa4ba None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.456155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-1833d9f9-e92c-496c-ab7b-dd32727eb6a0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:47.466894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:47.467862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:47.468664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 97/188] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:47.470096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.470452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.470821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.494294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:47.496178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:47.568375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99dee-604c-4a8d-af16-aa91242fa4ba None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.586144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 98/189] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:47.587027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.608078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.610068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.610993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.611722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.626663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.628137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd594d99-89ac-4c6c-93e8-0e4576709aef None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.629842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 92/190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.631326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7d8-f8d2-430b-935b-509dbafbbf1e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.631513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7d8-f8d2-430b-935b-509dbafbbf1e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.631745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf1c7d8-f8d2-430b-935b-509dbafbbf1e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.633088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 93/191] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:47.633617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c7d8-f8d2-430b-935b-509dbafbbf1e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.684854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82a98d-a6d2-467b-a44e-58b27ce44fd3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.717257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.717861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.718143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.718417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.719201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:47.719510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.720896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9404a894-b040-467d-b469-009c25c75b21 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.728517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf1c7d8-f8d2-430b-935b-509dbafbbf1e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.728640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 99/192] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.729809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.730100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.730377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.749976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:47.751192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:47.762395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.763233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.763517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.763793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.764957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.766411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.768046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 94/193] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.768797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.817635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 100/194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:47.830756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.863035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a5f4d-f1ce-4d28-8c22-0698cbc887c7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.895738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.896385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.896712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.897484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.923025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297407-e911-43bd-9c00-e198f8259ff7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:47.956345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:47.957225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:47.957506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:47.957785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] PATH_INFO: `/v3/users/9bf2a4b9fd354f4caf7010c05996af81` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:47.959005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] RBAC: Authorizing `identity:get_user(user_id=9bf2a4b9fd354f4caf7010c05996af81)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.961241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:47.962269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:47.963269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 101/195] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/users/9bf2a4b9fd354f4caf7010c05996af81 => generated 289 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:47.963804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:47.968284 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.058315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca090df-9ae5-4873-b76e-f762265e611f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.060670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 95/196] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:48.061491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.091872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.092542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.092824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.093101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.093799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.095276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.113243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 102/197] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:47 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:48.114051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.160477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d4c19-82c0-47a0-82db-b8c1ca2dd392 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.196992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.197823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.198101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.198372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.210045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:48.218601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:48.220366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:48.221490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 96/198] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:48.224783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62d0df-47a1-4210-843a-6a29e4d9907b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.225471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.260002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.260672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.260959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.261244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.329461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.331139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bb4782-7343-4402-a41d-32b7ef01353e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.331274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.366812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.369607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.369607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.369607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.371780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.374674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.374674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 97/199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:48.375241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.434525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 103/200] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:48.435485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.484520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a73e04-d460-4b39-a8ad-d425f5640085 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.525035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.525719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.526003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.526279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.527063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:48.527373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.528752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.537116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 98/201] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:48.537765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.551688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceac6b3-4bce-402b-9b9d-277a33e9f625 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.596804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.597786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.598195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.598623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.599623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=d1502f27059f46daa520a87f562cbcb9) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:48.600586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.602342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.609831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 104/202] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/role_assignments?user.id=d1502f27059f46daa520a87f562cbcb9&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:48.614771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.670182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e197ee8-016b-483b-9736-56f43811ea8e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.744749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.745559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.745846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.747266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.749777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.751304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.753115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 99/203] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:48.763797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.821987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd1072-a805-4828-b552-25ad2f05d966 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:48.866733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:48.867942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:48.868230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:48.868670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:48.869975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:48.871520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:48.873924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:48.879437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:48.949421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb53fa-5a89-4e4b-81ff-fa564886a150 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:49.010182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:49.012265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:49.012554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:49.012830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:49.013665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, scope.project.id=c35882aa340145a790db6ed86cf9a294, user.id=9bf2a4b9fd354f4caf7010c05996af81) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:49.013976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:49.016213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:49.025375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/role_assignments?user.id=9bf2a4b9fd354f4caf7010c05996af81&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 608 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:49.033193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990b8-44e3-4f7e-937c-d838c4cb9d32 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:49.071415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:49.072147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:49.072438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:49.072717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:49.148885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:49.150370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:49.276735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 106/206] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:58:49.282412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:49.410171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27152d67-b8ca-4368-9f10-e25378029b8a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:49.445460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:49.446328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:49.446628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:49.446903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:49.448084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:49.449512 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10d495e-1431-4ef2-a930-83db9ebcbbe5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:49.451571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:49 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:49.457020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:49.570356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9349238-c867-43cb-b9f2-12d6a8eaec29 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:49.607457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:49.608422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:49.608901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:49.609343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:49.610337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=d1502f27059f46daa520a87f562cbcb9) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:49.610850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:49.612702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a4e51-ae2a-4379-90f0-f8566d2a7384 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:49.619597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:49 2022] GET /identity/v3/role_assignments?user.id=d1502f27059f46daa520a87f562cbcb9&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=6aada032643443b8a7ee169eadfab258 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:50.636619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbeabe-19b6-40c5-ab6c-570bfcd36bf2 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.639112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbeabe-19b6-40c5-ab6c-570bfcd36bf2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.639867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbeabe-19b6-40c5-ab6c-570bfcd36bf2 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.641797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:50.647662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.648090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.648179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.665871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:50.667488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:50.699470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05b4c-cad1-46f2-bf0b-778daab45594 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.699773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05b4c-cad1-46f2-bf0b-778daab45594 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.700019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db05b4c-cad1-46f2-bf0b-778daab45594 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.701373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 103/210] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:50.706384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.706687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.706958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.723557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:50.724794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:50.742912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 108/211] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:50.767426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:50.806912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 104/212] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:50.821498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:50.894252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6bbaff-231d-404f-86b7-8aa5ad2cc3a8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:50.924386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae945ed-1f8a-4a83-9b9a-4e1c0184c2fa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:50.938274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:50.939757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.940156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.940432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.941775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:50.944101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:50.946362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 109/213] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:50.952404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:50.968231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:50.969038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:50.969316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:50.969588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:50.982880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:50.993367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:50.994276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:50.995119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 105/214] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:51.003511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.064472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38af49f-7f4d-49dc-9189-b5f5d19e32d2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.097965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.098652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.098937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.099210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.099949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.100440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782fb9e-e52b-43ad-8b55-08c7580b0c49 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.101485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df82142-8b27-4492-937b-929ef1941af4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.122134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 110/215] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:50 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:51.123472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8316-e29b-4a55-870e-f64c9efc20dc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.123765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8316-e29b-4a55-870e-f64c9efc20dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.125055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab8316-e29b-4a55-870e-f64c9efc20dc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.126621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 111/216] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:51.133717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.134511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.134965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.147535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.148404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.148784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.149160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.150040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:51.150474 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.152725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.158673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:51.161474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:51.165075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 106/217] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:51.170842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.258106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 112/218] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:51.280768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.296447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bd4f4-033a-49c2-bacb-36fe0ba1a1fc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.334172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.336293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.336293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.336293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] PATH_INFO: `/v3/users/e7b136ac7cce42c88d6887aad3d7bc60` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.356783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b136ac7cce42c88d6887aad3d7bc60)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.359055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.362154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 107/219] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/users/e7b136ac7cce42c88d6887aad3d7bc60 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:51.367945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.408906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e9b0-20ed-4e14-ab81-954eff2a7057 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.453383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.454489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.455059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.455519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.469567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:51.483545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:51.484478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:51.485271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:51.485891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ae9f3-806d-4518-8e6b-fc5496649b73 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.485972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 113/220] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:58:51.493454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.518997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.519713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.520046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.520220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.606235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.609524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.616745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcd65eb-8be9-461b-b41e-bcf6c530f631 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.654313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.655137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.655637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.655924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.656957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:51.657265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.658834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.669398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 114/221] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:51.675384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.785777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2616f29e-1091-47d5-8ae5-3e46db2530bb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:51.807655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 108/222] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:58:51.814135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:51.840520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:51.841418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:51.841743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:51.842021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:51.843270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:51.845106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:51.847650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 115/223] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:51.854441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.007613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbbc84-3f14-460d-841f-96dd19ac550f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.010611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667adc23-e7e4-4025-9cb5-d1a84a87745d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.041578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.042589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.042795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.043035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.044216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.045650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3b9af-acf9-4e45-a970-d2cf590f11d3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 109/224] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843579-8276-4c99-b5f4-903f304a30b8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843579-8276-4c99-b5f4-903f304a30b8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73843579-8276-4c99-b5f4-903f304a30b8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 110/225] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:52.053503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73843579-8276-4c99-b5f4-903f304a30b8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.061661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.062828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.063947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.064405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.066142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.068568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12f8bf-5b17-4bff-9bfc-38d06502bcb8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.071766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 116/226] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:51 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:52.073685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.074150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.074618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.096175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:52.098058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:52.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73843579-8276-4c99-b5f4-903f304a30b8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.179444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 117/227] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:52.183000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.222540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.223369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.223718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.224243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.226052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=e7b136ac7cce42c88d6887aad3d7bc60) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:52.226435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.228490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.235690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 111/228] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:52 2022] GET /identity/v3/role_assignments?user.id=e7b136ac7cce42c88d6887aad3d7bc60&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:52.242600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.342740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3979af5-a932-4f53-851a-74082bbe23fd None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.373766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.374716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.375044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.375323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/users/d1502f27059f46daa520a87f562cbcb9/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.377369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, user_id=d1502f27059f46daa520a87f562cbcb9, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.378903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.394892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 118/229] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:52 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/users/d1502f27059f46daa520a87f562cbcb9/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:52.460422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7b74a-56e9-4529-ad56-659640514c30 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.500295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.501120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.501397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.501668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.513790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:52.522308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:52.523326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:52.524137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 112/230] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:52.529807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.638746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731df3-23fb-4b7c-a158-7ad417823b2a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.675561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.676229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.676505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.676777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.677527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:52.677953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.679610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.689254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 119/231] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:52.695527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:52.827932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb8bb2e-ca3e-456c-a630-b358d0b3cae3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:52.879411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:52.880668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:52.881872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:52.882387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:52.883830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:52.885485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:52.887681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 113/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:52 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:52.892859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:53.030135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb11ce-e590-4b9d-9c92-a82568c22394 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:53.075379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:53.076247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:53.076529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:53.076805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:53.083356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:53.084860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c85501-a76d-40a9-9011-cc9557e04a63 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:53.086988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 120/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:52 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:53.092561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:53.229738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d84e69-3a6c-45bf-8062-af172c83d750 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:53.266546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:53.267469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:53.267750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:53.268022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/users/d1502f27059f46daa520a87f562cbcb9/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:53.270258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, user_id=d1502f27059f46daa520a87f562cbcb9, role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:53.271888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c37b5f-5910-4b1e-963e-aa521dd2d8fe None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:53.288463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:53 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/users/d1502f27059f46daa520a87f562cbcb9/roles/6aada032643443b8a7ee169eadfab258 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:53.935175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195699c9-4651-4e92-aa7d-caf5009c2c36 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:53.935620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195699c9-4651-4e92-aa7d-caf5009c2c36 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:53.935808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195699c9-4651-4e92-aa7d-caf5009c2c36 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:53.937372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 121/235] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:53.942663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:53.943071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:53.943238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:53.970608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:53.970608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:54.056161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:54.104158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195699c9-4651-4e92-aa7d-caf5009c2c36 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:54.240716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195699c9-4651-4e92-aa7d-caf5009c2c36 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:54.284203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:54.285013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.285294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.285565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.286771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:54.288272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd9f4-39a8-473e-b71a-a54930a67e9b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:54.290237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 122/237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:54.295551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:54.354409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c0-0a3a-47d9-9896-a7bdde9d776a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.354746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c0-0a3a-47d9-9896-a7bdde9d776a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.354999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6137f7c0-0a3a-47d9-9896-a7bdde9d776a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.356608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 123/238] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:54.361663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.361952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.362228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.395641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:54.397930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:54.411801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a4edc-10a0-4ff5-89b2-fdc4574113d2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:54.446954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:54.447636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.447919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.448193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.448899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:54.450339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:54.484966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 116/239] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:54 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:54.508253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 124/240] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:54.543678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:54.692241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62183eaf-ca36-4025-a4a5-76ec71c3b3f8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:54.726429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:54.727257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.727542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.727837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.737815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:54.745997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:54.746894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:54.747780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 117/241] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:54.755000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:54.864211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da348043-b78e-4fc0-a121-a4449ad76eee None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:54.907629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:54.908337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:54.908623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:54.908897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:54.909672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:54.909980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:54.911451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90dd103-48b3-4f2e-8daf-e4befdc5b79f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:54.929302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 125/242] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:54.935068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.031681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103dc-6af6-4bfc-a0d7-025633c164f2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.032206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103dc-6af6-4bfc-a0d7-025633c164f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.032206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2103dc-6af6-4bfc-a0d7-025633c164f2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.033857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 126/243] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:55.039792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff19760-076e-4779-b076-be42be0a6b3c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.040081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff19760-076e-4779-b076-be42be0a6b3c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.040364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff19760-076e-4779-b076-be42be0a6b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.060887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7ff19760-076e-4779-b076-be42be0a6b3c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:55.061073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f1c0cd-b014-414f-a1f6-043f1496ef0d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.062063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7ff19760-076e-4779-b076-be42be0a6b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:55.100072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.101207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.101511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.101768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] PATH_INFO: `/v3/users/37a53c1a89f246b28f5f77ad448bdbf2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.123431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] RBAC: Authorizing `identity:get_user(user_id=37a53c1a89f246b28f5f77ad448bdbf2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:55.124849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aabd30-a0a6-460a-9715-b714e9bd16e9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:55.127103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 118/244] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:54 2022] GET /identity/v3/users/37a53c1a89f246b28f5f77ad448bdbf2 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:55.128017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2f19-aefb-40f0-9f7e-0c750172f9d3 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.128305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2f19-aefb-40f0-9f7e-0c750172f9d3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.128578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c2f19-aefb-40f0-9f7e-0c750172f9d3 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.129953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 119/245] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:55.132605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2f19-aefb-40f0-9f7e-0c750172f9d3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.137613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 127/246] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:55.144050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.144338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.144617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.161468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:55.162936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:55.258688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 128/247] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:55.259590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.280638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c2f19-aefb-40f0-9f7e-0c750172f9d3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.329573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.329573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.329573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.329573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.416820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67c5ac-6147-4312-b5d8-06328ea19092 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.452472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:55.455053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:55.481165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.482077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.482368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.482674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.493962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:55.503173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:55.504063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:55.504880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 129/248] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:55.505560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.618022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985a256-46e7-4ded-b928-13d424e20a42 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.639861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 120/249] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:55.641073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.658520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.659957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.660251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.660528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.673881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:55.683634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:55.684584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:55.685400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 130/250] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:55.686561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.770241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f62072b-0d97-46e0-b479-86e5f2ca84d6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.804766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.805445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.805730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.806005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.806786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:55.807088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:55.808458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:55.817604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 121/251] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:55.818542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:55.921584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e609b0-784e-4287-9e6e-8697b2cf4c6d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.932537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa61c0c-e51b-46e7-9243-9fd73ce2e5c6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:55.953308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:55.953985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:55.954268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:55.954547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:55.955420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:55.955728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:55.957163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:55.966481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 122/252] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:55.967543 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.039291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.040177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.040458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.040731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.041993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.043480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.045210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 131/253] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:56.045984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.070169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1efa2-938c-46de-a995-7d6ca8261079 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.106650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.107563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.107993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.108272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] PATH_INFO: `/v3/users/e7b136ac7cce42c88d6887aad3d7bc60` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.109585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b136ac7cce42c88d6887aad3d7bc60)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.111291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.113363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 123/254] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:55 2022] GET /identity/v3/users/e7b136ac7cce42c88d6887aad3d7bc60 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:56.114241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.218821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de21b6d7-b5a4-42bf-970c-5539a43dbad7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.248748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.249415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.249696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.249972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.250820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=37a53c1a89f246b28f5f77ad448bdbf2) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:56.251131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.252574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.259210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 124/255] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/role_assignments?user.id=37a53c1a89f246b28f5f77ad448bdbf2&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:56.260184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.274730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d069fbf-7c0f-4baf-9347-950c692d575f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.336175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.337096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.337378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.337652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.343438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.344938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.346691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 132/256] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:56.352790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.368842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fd98ce-a560-4f3b-830a-65c84feecb35 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.404510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.405382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.405661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.405935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.407166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.408634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defd2e48-79a9-449f-a02d-d508002ceaf4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.410371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 125/257] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:56.413168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9b7d-af12-4824-a3f5-73527f0c6a27 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.413451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9b7d-af12-4824-a3f5-73527f0c6a27 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.413726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac9b7d-af12-4824-a3f5-73527f0c6a27 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.415137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 126/258] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:56.420078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9b7d-af12-4824-a3f5-73527f0c6a27 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.570411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b33325-8492-4e1d-af9f-8e03e350acba None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.600359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ac9b7d-af12-4824-a3f5-73527f0c6a27 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:56.620445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.621109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.621390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.621664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.669879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:56.670803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.671086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.671362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/users/e7b136ac7cce42c88d6887aad3d7bc60/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.673415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, user_id=e7b136ac7cce42c88d6887aad3d7bc60, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.674987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b585e7a-0f2f-4eb1-b70d-52f431b224a3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.690291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 127/259] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:56 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/users/e7b136ac7cce42c88d6887aad3d7bc60/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:58:56.691751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:56.692092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:56.692429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:56.711268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:56.712585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:56.787854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:56.788078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 128/260] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:56.789693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:56.812576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:56.993887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 133/261] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:58:56.999721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:57.014518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6535b32-d449-4658-ae36-7d73afbe1df4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.107744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.108369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.108647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.108926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.134916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f765e4e-577e-441f-994e-4724737f2a14 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.139489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:57.150709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:57.151659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:57.152460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 129/262] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:57.157629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:57.175989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.177834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.178337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.178867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.180470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:57.182694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:57.185189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 134/263] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:56 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:57.192045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:57.336792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706dcbf-d3cd-4008-94c1-76f15e02113a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.342099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f0ecd-8882-426e-bcbc-f849ff0397eb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.371579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.372214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.372501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.372783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.373560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:57.373834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:57.375256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:57.384549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 130/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:57.386062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.386966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.387442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.387954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.389118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=d1502f27059f46daa520a87f562cbcb9) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:57.389622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:57.389809 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:57.391491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:57.402596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 135/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:57 2022] GET /identity/v3/role_assignments?user.id=d1502f27059f46daa520a87f562cbcb9&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:57.577280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5819d5d-5ad4-4991-a76d-4a56ca465a3c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.629036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.629957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.630239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.630514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] PATH_INFO: `/v3/users/d1502f27059f46daa520a87f562cbcb9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.635582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] RBAC: Authorizing `identity:get_user(user_id=d1502f27059f46daa520a87f562cbcb9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:57.637125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341530f8-21dd-4c3c-a415-4e583e8d7665 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:57.638973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 131/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:57 2022] GET /identity/v3/users/d1502f27059f46daa520a87f562cbcb9 => generated 283 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:57.644726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:57.770566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0446-89d1-434f-b874-d6391dc1f1cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:57.821567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:57.822251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.822536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.822837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.883960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2a5c1-431d-4763-889f-f7b81d6b42d3 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.884149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2a5c1-431d-4763-889f-f7b81d6b42d3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.884429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2a5c1-431d-4763-889f-f7b81d6b42d3 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.886067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 132/267] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:58:57.908131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514db4-9193-430f-8a0c-15fe019ea604 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:57.908436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514db4-9193-430f-8a0c-15fe019ea604 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:57.908685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81514db4-9193-430f-8a0c-15fe019ea604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:57.921486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:57.926165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:57.940692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-81514db4-9193-430f-8a0c-15fe019ea604 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:57.941878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-81514db4-9193-430f-8a0c-15fe019ea604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:58.067743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 136/268] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:58:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:58:58.074304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.088972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 133/269] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:58:58.090367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625a21-e07d-441f-8b4b-1fa80ffa6cbc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.090686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625a21-e07d-441f-8b4b-1fa80ffa6cbc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.090963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd625a21-e07d-441f-8b4b-1fa80ffa6cbc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.092484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 134/270] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:58.097190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.097479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.097753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.114850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:58.118550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:58.188435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 135/271] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:58.189498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.208441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ea48d-5035-4952-b62d-08fb37575b7d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.258326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.259313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.259595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.259885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.261063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.262506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.264530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 137/272] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:58:58.269814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.304683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86e236-40f0-4ab3-9204-cdcacfded60a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.340610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.341751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.342257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.342760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.354285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:58.362526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:58.363445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:58:58.364295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:58:58.364949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b6014-9736-4f4b-b7de-cdfb3f93bb7a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.367463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 136/273] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:58.368478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.399568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.400398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.400734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.401006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.402200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.403667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.405296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 138/274] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:58.406045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.478636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84408585-b84a-4a82-b9ee-10428708248a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.508800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f502a704-94b9-47d7-8919-79a57dc89e6d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.515190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.516135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.516624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.517098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.518125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=d1502f27059f46daa520a87f562cbcb9) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:58.518701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.520334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.527466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 137/275] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/role_assignments?user.id=d1502f27059f46daa520a87f562cbcb9&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=6aada032643443b8a7ee169eadfab258 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:58.535278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.543606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.544279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.544566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.544843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.545584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:58.545887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.554602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.556831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 139/276] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:58.567766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.685980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d7030-49c0-4242-a1c2-38ca5bb04bbb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.704794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aebbc24-20b5-4e45-ac7c-7f9115c08553 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.724791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.725870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.726149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.726424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] PATH_INFO: `/v3/users/1383009b83c14151a4b79d444ad28f8c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.741616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] RBAC: Authorizing `identity:get_user(user_id=1383009b83c14151a4b79d444ad28f8c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.742849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.744924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 140/277] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/users/1383009b83c14151a4b79d444ad28f8c => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:58.755702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:58.763602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.764630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.765130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.765603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.766564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.768303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa378f-0159-4253-a792-b7e35764523c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.805440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 138/278] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:58:58 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:58:58.901145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a56c7-6fb3-4213-bde0-28d967d9a663 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.901505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a56c7-6fb3-4213-bde0-28d967d9a663 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.901708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a56c7-6fb3-4213-bde0-28d967d9a663 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.904540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 139/279] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:58.909068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.909363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.909634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.915882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e251c38-a142-4835-a6fd-226a268ffab4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:58.928706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:58.929920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:58.982045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:58.982933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:58.983554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:58.983917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:58.985070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, user.id=1383009b83c14151a4b79d444ad28f8c, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:58.985385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:58.988644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:58.996243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 141/280] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 17 17:58:58 2022] GET /identity/v3/role_assignments?user.id=1383009b83c14151a4b79d444ad28f8c&scope.system=all&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:59.035069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 140/281] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:58:59.061004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:59.179967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab6c9b-d168-408b-ac93-6d42a2d4a01e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:59.218910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:59.220458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.220458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.220458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.231748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:58:59.239560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:58:59.240694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:58:59.241495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 142/282] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:58:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:58:59.246990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:59.358250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db9836-4764-4474-ad97-8a289fd3d9ef None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:59.397712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:59.398390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.398733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.399010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.399757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:58:59.400059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:59.401449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:59.411035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 141/283] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:58:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:59.417764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:59.528071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934819f4-ca66-4ed4-8759-6865b3eab564 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:59.563976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:59.565155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.565644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.566094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] PATH_INFO: `/v3/users/37a53c1a89f246b28f5f77ad448bdbf2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.567550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] RBAC: Authorizing `identity:get_user(user_id=37a53c1a89f246b28f5f77ad448bdbf2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:59.569788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:59.571665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 143/284] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:58:59 2022] GET /identity/v3/users/37a53c1a89f246b28f5f77ad448bdbf2 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:59.577298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:59.692329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb2af-6686-404a-9fb4-9e93bc4a99d3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:59.730066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:59.730959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.731242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.731513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.735274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:59.736720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707bca7-c198-4be4-b680-acc88d4275bf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:59.738420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 142/285] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:58:59 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:58:59.744933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:58:59.879309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff069-5eb2-4a70-8c5d-1528cf6e28e5 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.879917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff069-5eb2-4a70-8c5d-1528cf6e28e5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.880405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ff069-5eb2-4a70-8c5d-1528cf6e28e5 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.883496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 143/286] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:58:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:58:59.887684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cd128-4f6a-4440-8fcd-1932c269ee11 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:58:59.889098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.889610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.890080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.907608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:58:59.909180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:58:59.963364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:58:59.964293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:58:59.964572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:58:59.964860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/users/37a53c1a89f246b28f5f77ad448bdbf2/roles/f13bb00fd3294f6db01aa3e7df4326c8` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:58:59.967107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, user_id=37a53c1a89f246b28f5f77ad448bdbf2, role_id=f13bb00fd3294f6db01aa3e7df4326c8)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:58:59.968592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:58:59.990456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 144/287] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:58:59 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/users/37a53c1a89f246b28f5f77ad448bdbf2/roles/f13bb00fd3294f6db01aa3e7df4326c8 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:00.001624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 144/288] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:00.027051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:00.158674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5715c7ea-174c-4b5f-9f36-2dc74e12ef06 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:00.207603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:00.208411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:00.208703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:00.209516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:00.231811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:00.239826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:00.240820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:00.241703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 145/289] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:00.249162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:00.413697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52cbffd-fefb-46a0-8e04-6502862f7b57 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:00.460607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:00.461309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:00.461595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:00.461872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:00.462664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:00.462974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:00.464395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:00.478627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 145/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:00.483716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:00.633781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6cc13b-00ab-47bd-b979-4daaac8b7aa3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:00.690269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:00.691183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:00.691468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:00.691746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] PATH_INFO: `/v3/users/e7b136ac7cce42c88d6887aad3d7bc60` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:00.695280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] RBAC: Authorizing `identity:get_user(user_id=e7b136ac7cce42c88d6887aad3d7bc60)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:00.696758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:00.698746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 146/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:00 2022] GET /identity/v3/users/e7b136ac7cce42c88d6887aad3d7bc60 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:00.704055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:00.901848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47a07a-174d-4c78-be6f-ca25a3678d76 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:00.951579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:00.952301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:00.952585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:00.952979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.043382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:01.044844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:01.159979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 146/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:01.167677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:01.315604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d863af11-05b3-4153-b7d4-09822ea8e3c3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:01.359674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:01.360544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.360821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.361094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.363336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:01.364774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0234239b-df17-4a49-90d1-75ff8eb79646 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:01.367677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 147/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:01 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:01.374432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:01.515892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fa19fb-3f32-4c3d-8b14-c1bade904ad6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:01.572888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:01.573479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.573761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.574043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.574910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=e7b136ac7cce42c88d6887aad3d7bc60) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:01.575220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:01.576641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6ae805-d901-4528-8006-95b94d5fdf72 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:01.588753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 147/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:01 2022] GET /identity/v3/role_assignments?user.id=e7b136ac7cce42c88d6887aad3d7bc60&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:01.752521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614395db-4cd6-489b-be36-56e944220d49 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.752933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614395db-4cd6-489b-be36-56e944220d49 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.753126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614395db-4cd6-489b-be36-56e944220d49 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.754855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 148/295] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:01.760314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ef71-e186-45ff-9bef-5d942d03c35f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.760607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ef71-e186-45ff-9bef-5d942d03c35f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.760890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e215ef71-e186-45ff-9bef-5d942d03c35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.787023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e215ef71-e186-45ff-9bef-5d942d03c35f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:01.788425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e215ef71-e186-45ff-9bef-5d942d03c35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:01.888239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 148/296] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:01.911021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614395db-4cd6-489b-be36-56e944220d49 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:01.929848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2633e-8eb8-4012-aec9-35f82095d694 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.930159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2633e-8eb8-4012-aec9-35f82095d694 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.930403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e2633e-8eb8-4012-aec9-35f82095d694 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.931863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 149/297] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:01.939139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da909-24a5-4499-9096-5dcedb62e4e7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:01.939675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da909-24a5-4499-9096-5dcedb62e4e7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:01.939968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6da909-24a5-4499-9096-5dcedb62e4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:01.959710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ec6da909-24a5-4499-9096-5dcedb62e4e7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:01.961148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ec6da909-24a5-4499-9096-5dcedb62e4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:02.053721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 150/298] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:02.055007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbda8-31e9-4572-87e3-9cbfa392a316 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.055292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbda8-31e9-4572-87e3-9cbfa392a316 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.055569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bbda8-31e9-4572-87e3-9cbfa392a316 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.056856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 151/299] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:02.060213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614395db-4cd6-489b-be36-56e944220d49 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.066153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.066439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.066749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.089667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:02.090907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:02.104423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50139b79-438c-424d-8303-319a753aca0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.105483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50139b79-438c-424d-8303-319a753aca0c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.105934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50139b79-438c-424d-8303-319a753aca0c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.106373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50139b79-438c-424d-8303-319a753aca0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.116817 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50139b79-438c-424d-8303-319a753aca0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-50139b79-438c-424d-8303-319a753aca0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:02.125058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:02.126135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:02.127158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:02.129272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 149/300] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:02.130216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50139b79-438c-424d-8303-319a753aca0c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.159356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 152/301] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:02.160161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.241093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50139b79-438c-424d-8303-319a753aca0c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.263528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdaf63-64ac-41f4-ba8d-ef13aceb7639 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.274335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.275469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.275842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.276214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.285842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:02.294259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:02.295196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:02.296002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 150/302] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:02.297319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.302156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.303147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.303442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.303707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.304462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:02.304769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.306618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.316254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:02.322312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.394254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677e17f-823b-4bb2-9052-ce2d51dfc3e7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.421688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476568bf-99c8-476a-871a-3864c0218e2b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.428874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.429883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.430344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.430858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.432030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.433486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.435289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 151/304] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:02.439688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.456508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.457173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.457451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.457721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.458518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:02.459390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.460908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.473695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 154/305] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:02.473695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.541285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5de4a3-f70c-43e7-a5e8-f0d1c010698e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.574246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.575183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.575358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9d723d-a518-45cb-9999-1d3422611984 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.575459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.575731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] PATH_INFO: `/v3/users/1383009b83c14151a4b79d444ad28f8c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.577029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] RBAC: Authorizing `identity:get_user(user_id=1383009b83c14151a4b79d444ad28f8c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.578514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.580290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 152/306] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/users/1383009b83c14151a4b79d444ad28f8c => generated 293 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:02.584782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.611958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.612625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.612900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.613166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] PATH_INFO: `/v3/groups` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.613845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.615872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.631482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 155/307] 10.222.0.25 () {60 vars in 1134 bytes} [Tue May 17 17:59:02 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:02.642983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.721739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfdc60-86b5-460b-9fda-53ea44de24fb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.767921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.769296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.769730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.770131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] PATH_INFO: `/v3/users/2bb65c0779b545f4b47cddffbdfd01c6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.771750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9099d9-a3aa-4a9a-a802-1bc5771fb285 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.784974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] RBAC: Authorizing `identity:get_user(user_id=2bb65c0779b545f4b47cddffbdfd01c6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.786879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e53a7-8568-4770-9ef4-317753f26245 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.788896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 153/308] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/users/2bb65c0779b545f4b47cddffbdfd01c6 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:02.790422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5fa39-7c8b-4175-be07-dd2fc71c8354 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.790800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5fa39-7c8b-4175-be07-dd2fc71c8354 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.791146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5fa39-7c8b-4175-be07-dd2fc71c8354 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.792660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 154/309] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:02.795946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5fa39-7c8b-4175-be07-dd2fc71c8354 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.815835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.816591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.816927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.816927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] PATH_INFO: `/v3/system/users/1383009b83c14151a4b79d444ad28f8c/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.818911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1383009b83c14151a4b79d444ad28f8c, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.820296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846630e1-a1ae-4802-84fb-2da78ba2deb5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.830239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 156/310] 10.222.0.25 () {58 vars in 1334 bytes} [Tue May 17 17:59:02 2022] PUT /identity/v3/system/users/1383009b83c14151a4b79d444ad28f8c/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:02.831282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.831569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.831842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.852142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:02.853893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:02.932487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 157/311] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:02.939408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5fa39-7c8b-4175-be07-dd2fc71c8354 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:02.965804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:02.982834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:02.983417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:02.983696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:02.983967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:02.984877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, user.id=2bb65c0779b545f4b47cddffbdfd01c6, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:02.985187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:02.986850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:02.993110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 155/312] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/role_assignments?user.id=2bb65c0779b545f4b47cddffbdfd01c6&scope.system=all&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:03.082825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dd6a11-9e71-4bb7-8ae0-6ef65fda3b1e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:03.121068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:03.122249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:03.122797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:03.123292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:03.136020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:03.144397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:03.145382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:03.146322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:03.149283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 158/313] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:03.154958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:03.259040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e319974-c7a0-4807-a76e-dafbf3f65976 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:03.292523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:03.293194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:03.293472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:03.293742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:03.294474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] RBAC: Adding query filter params (name=reader) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:03.294806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:03.296326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:03.305412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 156/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:03.310510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:03.422470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fc0fd-1665-48cc-943a-0687bf57f2f4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:03.457471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:03.458351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:03.458677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:03.459084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] PATH_INFO: `/v3/users/37a53c1a89f246b28f5f77ad448bdbf2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:03.460293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] RBAC: Authorizing `identity:get_user(user_id=37a53c1a89f246b28f5f77ad448bdbf2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:03.461737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:03.463672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 159/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:03 2022] GET /identity/v3/users/37a53c1a89f246b28f5f77ad448bdbf2 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:03.468878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:03.572092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e5783-96ca-4db4-845a-8b65098421df None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:03.606508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:03.607192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:03.607472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:03.607748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:03.674920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:03.676389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:03.775470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 157/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:03.781031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:03.881259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d28b597-ed5c-4cc2-a02a-6a55873e8a44 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:03.915240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:03.916099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:03.916378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:03.916645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:03.917871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:03.919320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bc924-31ca-49a8-8407-d38bef490e39 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:03.922418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 160/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:03 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:03.926854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:04.028529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d5ae6-db9e-40a6-b140-3e08998dd5bb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:04.062654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:04.063627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:04.063909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:04.064182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:04.065064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, scope.project.id=a891da2b320f4003804e7f14c8964606, user.id=37a53c1a89f246b28f5f77ad448bdbf2) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:04.065373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:04.066901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8c4e55-1206-4442-9942-62e510b6fba6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:04.073625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 158/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:03 2022] GET /identity/v3/role_assignments?user.id=37a53c1a89f246b28f5f77ad448bdbf2&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:04.983769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea12e-ee83-4c44-b9d8-2f1c4c8f6899 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:04.984304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea12e-ee83-4c44-b9d8-2f1c4c8f6899 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:04.984304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbea12e-ee83-4c44-b9d8-2f1c4c8f6899 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:04.985661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 161/319] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:04.991693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339794f-77b2-45ca-995c-f32b4e0eff25 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:04.992080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339794f-77b2-45ca-995c-f32b4e0eff25 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:04.992241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339794f-77b2-45ca-995c-f32b4e0eff25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.008433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a339794f-77b2-45ca-995c-f32b4e0eff25 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:05.009592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a339794f-77b2-45ca-995c-f32b4e0eff25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:05.075958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 159/320] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:05.098118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea12e-ee83-4c44-b9d8-2f1c4c8f6899 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.133862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590f75-b2ae-41df-a58f-2266e965988d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.134418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590f75-b2ae-41df-a58f-2266e965988d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.134733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44590f75-b2ae-41df-a58f-2266e965988d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.136115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 160/321] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:05.141298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5474-ee6b-4701-8105-63760c082296 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.141584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5474-ee6b-4701-8105-63760c082296 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.141859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a5474-ee6b-4701-8105-63760c082296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.158620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9e4a5474-ee6b-4701-8105-63760c082296 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:05.159932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9e4a5474-ee6b-4701-8105-63760c082296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:05.199098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbea12e-ee83-4c44-b9d8-2f1c4c8f6899 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.232765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.233558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.233837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.234105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.234926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 161/322] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:05.235323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.236793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.238514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 162/323] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:05.243886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.244390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510232e-6f31-4e16-afa3-456eab19d32d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.244687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510232e-6f31-4e16-afa3-456eab19d32d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.244969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510232e-6f31-4e16-afa3-456eab19d32d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.246316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 162/324] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:05.252073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.252356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.252631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.270750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:05.272090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:05.334376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 163/325] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:05.335230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.343499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36769f-67de-4a83-8417-e9a12549ff55 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.376494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.377153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.377434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.377703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] PATH_INFO: `/v3/groups` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.378385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.379834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.392847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 163/326] 10.222.0.25 () {60 vars in 1134 bytes} [Tue May 17 17:59:05 2022] POST /identity/v3/groups => generated 226 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:59:05.393871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.438645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4bd8b-3706-4e0f-8fa4-57e5bb8f63dc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.478632 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.479378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.479664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.479939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.491607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:05.499790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:05.500761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:05.501583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 164/327] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:05.507503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.523496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15a3a-a06e-41ce-b47b-ed6be0847c5c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.562717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.563798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.564081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.564354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.575339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:05.583191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:05.584744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:05.585564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 164/328] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:05.591191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.617195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee510e4b-acfe-4822-a5cc-2d74f19d8ea1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.652511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.653219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.653504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.653784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.654541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:05.654903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.656307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.666316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 165/329] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:05.671886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.702740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da7672-72eb-4a5f-949a-80ee15c38fd0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.747370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.748406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.749476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.749928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.751026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:05.751496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.753274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.768771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 165/330] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:05.770249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.791989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850276b-daf9-4351-ba62-761ab7f0167b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.835286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.836178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.836463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.836743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] PATH_INFO: `/v3/users/1383009b83c14151a4b79d444ad28f8c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.838793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] RBAC: Authorizing `identity:get_user(user_id=1383009b83c14151a4b79d444ad28f8c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.840249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.842074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 166/331] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/users/1383009b83c14151a4b79d444ad28f8c => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:05.847596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.905329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982633ff-caf7-45b3-bb0c-b70c7724ea94 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:05.946929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:05.948169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:05.948670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:05.949138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] PATH_INFO: `/v3/users/2bb65c0779b545f4b47cddffbdfd01c6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:05.950540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] RBAC: Authorizing `identity:get_user(user_id=2bb65c0779b545f4b47cddffbdfd01c6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:05.952206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:05.954349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 166/332] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/users/2bb65c0779b545f4b47cddffbdfd01c6 => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:05.960352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:05.961685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01aac740-465a-433d-bf85-0c3009a7ee6a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:06.006643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:06.008131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:06.008613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:06.009083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:06.010106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] RBAC: Adding query filter params (role.id=56e6612f0b624b24b14d5d60b68b2ceb, user.id=1383009b83c14151a4b79d444ad28f8c, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:06.010640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:06.012504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03250e14-1c1d-4098-b13f-a6f27d0d5dd3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:06.025604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 167/333] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 17 17:59:05 2022] GET /identity/v3/role_assignments?user.id=1383009b83c14151a4b79d444ad28f8c&scope.system=all&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:06.076481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea512e48-177d-481b-ba44-b967f2c34eac None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:06.113636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:06.114510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:06.114880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:06.115676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] PATH_INFO: `/v3/system/users/2bb65c0779b545f4b47cddffbdfd01c6/roles/f13bb00fd3294f6db01aa3e7df4326c8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:06.117320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2bb65c0779b545f4b47cddffbdfd01c6, role_id=f13bb00fd3294f6db01aa3e7df4326c8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:06.118768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dc3399-dfd6-4bd4-92a8-53d37f2cd89b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:06.128208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 167/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue May 17 17:59:05 2022] PUT /identity/v3/system/users/2bb65c0779b545f4b47cddffbdfd01c6/roles/f13bb00fd3294f6db01aa3e7df4326c8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:59:07.892626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52ce-f9b4-48c0-a66e-a14feb872872 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:07.893674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52ce-f9b4-48c0-a66e-a14feb872872 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:07.894161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f52ce-f9b4-48c0-a66e-a14feb872872 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:07.896554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 168/335] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:07.902816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd07fa-3c0a-4676-83ca-b6988e6eff3a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:07.903787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd07fa-3c0a-4676-83ca-b6988e6eff3a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:07.904267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd07fa-3c0a-4676-83ca-b6988e6eff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:07.924627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5edd07fa-3c0a-4676-83ca-b6988e6eff3a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:07.926093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5edd07fa-3c0a-4676-83ca-b6988e6eff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:07.996743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 168/336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:08.021629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f52ce-f9b4-48c0-a66e-a14feb872872 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.123886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1c03-ce05-4aac-8394-820f4c0673ba None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.124550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1c03-ce05-4aac-8394-820f4c0673ba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.125026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a1c03-ce05-4aac-8394-820f4c0673ba None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.129082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f52ce-f9b4-48c0-a66e-a14feb872872 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.129201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 169/337] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:08.148565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.149153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.149631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.165992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.166823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.167100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.167827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.173919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:08.175385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:08.185491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:08.193569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:08.194506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:08.195689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:08.199148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 169/338] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:08.220418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.258133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 170/339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:08.344070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.345909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0cfd8-29fd-473e-8f6f-e2ad59e8b44b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.383568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.384611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.385098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.385576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.386517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:08.387060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:08.388672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:08.400249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 170/340] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:08.406000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.488628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634062e7-c341-49e2-ad92-e258e60bc825 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.517173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b9ac0d-404e-4525-a765-e7147607739b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.539763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.540637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.540979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.541194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.554028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:08.554366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.555282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.555769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.556242 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:08.566926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:08.567919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:08.568764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:08.573085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 171/341] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:08.574319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.629117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:08.631260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:08.738643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 171/342] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:59:08.742336 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fcf009-7d0a-4bf1-aace-8d4c1d52d731 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.745318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.816267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.816980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.817430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.817712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.818513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:08.818851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:08.820339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:08.838113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 172/343] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:08.843612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:08.846315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd13db-8611-45b7-8eec-34d125b16298 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:08.886360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:08.887359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:08.887637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:08.887911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:08.889662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:08.891361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:08.895190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 172/344] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:08.903813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:09.034794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2e26c-7f1d-4bf3-a9b3-62f5059c8be0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.044972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30da2e8-943f-4dbe-b797-f641c7a61fe7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.077148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.078023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.078299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.078590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.092629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.093305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.093590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.093866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.095325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.096805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.098839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 173/345] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:09.104544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:09.192725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.203731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.298951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f07f42-af6f-4f79-ad00-ab8ff0a7ddd7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.330032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 173/346] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:59:09.336059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:09.364746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.365790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.366281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.366838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.367927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=c35882aa340145a790db6ed86cf9a294) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:09.368460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.370230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.385550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 174/347] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:09 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 260 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:09.468601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45870a61-c359-457f-bdd3-ae23fb62ce6e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.509699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.510596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.510887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.511244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.512483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.513918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9cb417-5dfc-4b16-bcc2-7b6be0ed148f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.515959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 174/348] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:09 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:09.522314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:09.636561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7473-0944-4672-9a4f-0d6c66973636 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.636743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7473-0944-4672-9a4f-0d6c66973636 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.637028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb7473-0944-4672-9a4f-0d6c66973636 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.638678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 175/349] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:09.653104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a3d9-c438-48eb-9ac8-e966f057f781 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.653807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a3d9-c438-48eb-9ac8-e966f057f781 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.654305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2a3d9-c438-48eb-9ac8-e966f057f781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.662611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706b88f3-8bd1-4d3e-834d-706a5e2eecd2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.687004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aac2a3d9-c438-48eb-9ac8-e966f057f781 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:09.688812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aac2a3d9-c438-48eb-9ac8-e966f057f781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:09.702029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.702935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.703215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.703487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.707338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.709507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.711600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 175/350] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:09 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:09.717060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:09.822802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 176/351] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:09.823971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68710-2183-4ff6-b9dc-36d1b1c35c2a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.824260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68710-2183-4ff6-b9dc-36d1b1c35c2a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.824528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68710-2183-4ff6-b9dc-36d1b1c35c2a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.825767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 177/352] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:09.836099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.836387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.836657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.851987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c5d7f-6d46-468f-9b0b-b4d42a6bea01 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:09.868556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:09.868770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:09.890057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:09.891132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:09.891651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:09.892207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:09.893236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=c35882aa340145a790db6ed86cf9a294) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:09.893793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:09.895480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:09.903324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 176/353] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:09 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=6aada032643443b8a7ee169eadfab258 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:09.904439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.014075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b2a8-c808-4ae9-b012-dbbed638df07 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.037882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 178/354] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:10.055126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.056019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.056317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.056596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.073450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:10.085471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:10.086435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:10.087349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 177/355] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:10.094852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.127949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.250945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3227fb67-94cf-47e2-839f-5780dd84ab9c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.286376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.287209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.287909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.288188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.289085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:10.289389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:10.290999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:10.300817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 179/356] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:10.301095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f82624-322c-467b-9a37-e3bb496e14e5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.308529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.364590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.364590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.364590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.364590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.393436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-df426d13-9048-45b1-b6ce-5f31db07fbb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:10.402400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:10.403478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:10.404285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:10.407114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:10.408584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbce6-2d3f-4bf6-9107-ac41aee8d456 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.409099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbce6-2d3f-4bf6-9107-ac41aee8d456 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.409583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cbce6-2d3f-4bf6-9107-ac41aee8d456 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.411289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 179/358] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:10.429232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.429864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.430356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.458489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:10.461914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:10.480465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ecbfe-4dba-4afd-9895-981bebc3eb09 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.524485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.525292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.525577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.525852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] PATH_INFO: `/v3/users/2bb65c0779b545f4b47cddffbdfd01c6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.527134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] RBAC: Authorizing `identity:get_user(user_id=2bb65c0779b545f4b47cddffbdfd01c6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:10.528570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:10.530560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 180/359] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/users/2bb65c0779b545f4b47cddffbdfd01c6 => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:10.531447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.573125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 180/360] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:10.573991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.647879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38949435-0dad-4c3c-ae50-1c8c7cb12a07 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.699466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde4d5d-f713-490c-93d9-e26d71c35c3d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.703685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.704356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.704639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.704914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.705719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:10.706027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:10.707444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:10.720985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 181/361] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:10.721852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.743971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:10.744999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:10.745514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:10.745996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:10.747076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] RBAC: Adding query filter params (role.id=f13bb00fd3294f6db01aa3e7df4326c8, user.id=2bb65c0779b545f4b47cddffbdfd01c6, scope.system=all) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:10.747608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:10.749286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:10.775596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 181/362] 10.222.0.25 () {56 vars in 1308 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/role_assignments?user.id=2bb65c0779b545f4b47cddffbdfd01c6&scope.system=all&role.id=f13bb00fd3294f6db01aa3e7df4326c8 => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:10.776306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:10.953392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faadf48-93c2-4f73-8e54-1b208b095b00 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:10.969839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f32da6-8f93-4763-ad9b-a1fe7c900afa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.026181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.027400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.027906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.028395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.041351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:11.044724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.044724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.044724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.044724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:11.053539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:11.054597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:11.055452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:11.058225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 182/363] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:11.067414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.197414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b4a7dc-464b-4e7b-b583-f694328d7bbe None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.203833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.205314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.236122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.237237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.237769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.238269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.239288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:11.239955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.242249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3958b6-21dc-48f3-842c-a469dad4504c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.251789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 183/364] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:11.253525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0da21-581e-4711-9535-c2b8166b8896 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.254038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0da21-581e-4711-9535-c2b8166b8896 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.254533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0da21-581e-4711-9535-c2b8166b8896 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.257429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 184/365] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:11.268194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.268820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.269327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.296100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:11.297199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:11.341705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 182/366] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:11.342555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.378390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 185/367] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:11.379441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.445941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ae940-ea8b-4859-ae2e-3748a6a4da6d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.487989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.488651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.490243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.490477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.497462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38895d9c-f91c-4ba6-b2dc-e6b9e59cb35e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.535098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.536327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.536851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.537359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.538803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.540423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.542746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 186/368] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:11.543699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.561437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.564118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.646760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9d1c-4e3f-4108-a3f1-435e6a85ffa1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.662508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 183/369] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:11.663577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.683238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.684373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.684847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.685755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.699994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:11.709969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:11.710992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:11.711793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:11.714916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 187/370] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:11.716348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.770273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af38e3ab-ac5c-453d-b9c1-5f1bac0b13c6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.812189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.814185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.814678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.815060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.816327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.817882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.819847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 184/371] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:11.820810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.841709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58851d25-7aeb-4b36-ad3c-d5288d28d3a5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:11.884340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:11.885219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:11.885500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:11.885773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:11.887058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:11.888548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:11.890557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 188/372] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:11.895572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:11.952799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8dca6-0ed0-45a5-80a8-662f561196dd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.008312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.009672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.010103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.010556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.011586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:12.012130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.015183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.029348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 185/373] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.029348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.040344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42846fed-c005-4e99-9553-a4ecadb9c3d7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.087970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.088572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.088844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.089121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.089992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=a891da2b320f4003804e7f14c8964606) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:12.090469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.092535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.100478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 189/374] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:11 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.101887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.163117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dafe8-4e37-469a-9946-3023cc58b75e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.213320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.214673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.215194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.215680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.217125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.218844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.221625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 186/375] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.228853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.321503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6b7dd-9448-4555-bfc6-ea53b60384e9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.360733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83004939-0f1d-4468-858f-218968ee309f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.361637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004939-0f1d-4468-858f-218968ee309f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.362064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004939-0f1d-4468-858f-218968ee309f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.362492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83004939-0f1d-4468-858f-218968ee309f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.375808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fba41a-ef34-42b2-861e-e9c560a0da97 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.421179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.421857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.422136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.422410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.424830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=a891da2b320f4003804e7f14c8964606) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:12.425143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.426716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.434637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 187/376] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=6aada032643443b8a7ee169eadfab258 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.453767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83004939-0f1d-4468-858f-218968ee309f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.455887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83004939-0f1d-4468-858f-218968ee309f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.568976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 190/377] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:12.574361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.712072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0becc1a7-ec40-4927-982e-7a66f2e6b53f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.713317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545c74-5f3b-438d-9727-ec44a2c3d136 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.713635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545c74-5f3b-438d-9727-ec44a2c3d136 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.713883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95545c74-5f3b-438d-9727-ec44a2c3d136 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.715456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 191/378] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:12.721285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.721829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.722319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.747650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:12.749154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:12.755636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.756623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.756908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.757187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] PATH_INFO: `/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.759315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] RBAC: Authorizing `identity:get_project(project_id=ce77dde206fe428ba1cf2d3583c7c4a2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.762599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.765652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 188/379] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2 => generated 344 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.773489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.866080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 192/380] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:12.885236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61a00c-ccc3-4183-9780-2d4a1ab9f02b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:12.902584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:12.923055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:12.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:12.924839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:12.925379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] PATH_INFO: `/v3/groups/0e0833fb4580401aa6d499ad851fa448` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:12.932568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] RBAC: Authorizing `identity:get_group(group_id=0e0833fb4580401aa6d499ad851fa448)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:12.934099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:12.936282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 189/381] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/groups/0e0833fb4580401aa6d499ad851fa448 => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:12.942378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.027553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b1b1e5-908d-4fd8-98b9-1e4940ef9c27 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.048216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb10a881-ade8-44b6-9d58-156ac3d77458 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.062176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.063426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.063810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.064279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.076238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:13.084592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:13.084982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:13.086079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:13.087118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:13.088459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.088875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.089336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.090420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] RBAC: Adding query filter params (group.id=0e0833fb4580401aa6d499ad851fa448, role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=ce77dde206fe428ba1cf2d3583c7c4a2) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:13.090950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:13.092564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:13.093804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 193/382] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:13.095067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.100700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 190/383] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:12 2022] GET /identity/v3/role_assignments?group.id=0e0833fb4580401aa6d499ad851fa448&scope.project.id=ce77dde206fe428ba1cf2d3583c7c4a2&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:13.232036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3d41d1-8614-409b-9027-27b597b602dd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.270293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.271642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.272030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.272309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.273077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:13.273384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:13.274892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e818f21-2151-433e-90b0-79e3e3801376 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:13.284256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 194/384] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:13.290858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.342765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40527e7d-7a89-4cd4-8d56-13aac618544f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.343719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40527e7d-7a89-4cd4-8d56-13aac618544f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.344057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40527e7d-7a89-4cd4-8d56-13aac618544f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.346936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 195/385] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:13.356488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.356488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.356488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.380857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:13.382136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:13.406028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8ea8b-902b-4f10-ab0a-965b7fe89c26 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.448211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.449968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.451394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.453149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.454999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:13.457846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:13.468864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 191/386] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:13.497466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.512771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 196/387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:13.543001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.663841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4055131c-4037-4b57-afcf-0b06b6bafff9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.682230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e765a07-71e5-4a56-8d36-014126589241 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.711157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.712623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.713565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.714304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.732843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:13.735795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.736657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.736934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.737207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.743281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:13.744740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:13.746439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 192/388] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:13.748999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:13.749894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:13.751323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 197/389] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:13.755814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.756364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:13.868910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4d978-e4a0-4e95-aa77-9dad8f731cd8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:13.908416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde0797-a461-4696-8375-f742ea331831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:13.910489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde0797-a461-4696-8375-f742ea331831 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:13.912639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde0797-a461-4696-8375-f742ea331831 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:13.913157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde0797-a461-4696-8375-f742ea331831 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:13.914801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde0797-a461-4696-8375-f742ea331831 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:13.918204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde0797-a461-4696-8375-f742ea331831 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:13.920263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde0797-a461-4696-8375-f742ea331831 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:13.940142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 198/390] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:13.947840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde0797-a461-4696-8375-f742ea331831 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:14.000744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ddecc-986a-440d-8283-a5c24e970645 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:14.064496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde0797-a461-4696-8375-f742ea331831 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:14.096151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:14.097724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:14.098202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:14.098700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:14.102502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:14.103490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:14.103776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:14.104099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:14.104807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, group_id=792d7e199fbd48bfa22bf931c9c3d664, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:14.105270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:14.106706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:14.106812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:14.108684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 199/391] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:13 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:14.114617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:14.135389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 193/392] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 17 17:59:13 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:14.256590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ea2a6-d51a-4032-b879-517259af5944 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:14.299687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:14.300562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:14.300843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:14.301115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:14.302357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:14.303830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b8ec4-1b4b-463d-ad19-5fb0cd55d97c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:14.308197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 200/393] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:14 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:14.311308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:14.447869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813ef5a-7caf-4c12-8419-45a45b41359a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:14.482473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:14.483767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:14.484246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:14.484714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:14.487176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] RBAC: Authorizing `identity:create_grant(project_id=c35882aa340145a790db6ed86cf9a294, group_id=792d7e199fbd48bfa22bf931c9c3d664, role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:14.488856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a194789e-a17a-4997-8ecc-9477dd1a0947 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:14.508572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 194/394] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 17 17:59:14 2022] PUT /identity/v3/projects/c35882aa340145a790db6ed86cf9a294/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/6aada032643443b8a7ee169eadfab258 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:15.021594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c92-0182-48cc-b973-51bbab04dbcb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.022137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c92-0182-48cc-b973-51bbab04dbcb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.022137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e21c92-0182-48cc-b973-51bbab04dbcb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.023816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 201/395] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:15.028977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.029274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.029554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.047251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:15.048444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:15.130086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 195/396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:15.170419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21c92-0182-48cc-b973-51bbab04dbcb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.316225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e21c92-0182-48cc-b973-51bbab04dbcb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:15.362034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:15.362875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.363158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.363433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] PATH_INFO: `/v3/roles/member` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.379725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-d7f1fc20-7a92-4700-8218-fcd619c6cccd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:15.387917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:15.388820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:15.390217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 202/397] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:15.397822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.532459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2534df09-915c-432e-856c-cc7b1ab10bf9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:15.535963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321810ff-b174-4bd8-8a94-8985741fb286 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.536257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321810ff-b174-4bd8-8a94-8985741fb286 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.536790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321810ff-b174-4bd8-8a94-8985741fb286 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.538451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 203/398] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:15.544813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.544813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.544813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.574691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:15.575707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.576189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.576308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:15.576769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.577444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:15.577935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:15.578449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:15.580075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:15.589331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 196/399] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:15.594561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.708892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd068f1-c964-4599-b065-bbad11d582e9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:15.742952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 204/400] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:15.746500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:15.747621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.748122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.748613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.750003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:15.751706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:15.753818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 197/401] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:15 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:15.759678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.788417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.906755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f977537-797d-461b-8ffd-6a6f5e4b5c54 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:15.925574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887c833-e735-45d4-94bc-1903ce29d1a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:15.953218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:15.954091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.954368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.954658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.959653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:15.959848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:15.960477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.961737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.961737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.961904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9231be44-6c0e-41f9-979b-c7ab988526ad None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:15.963275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 205/402] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:15 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:15.966466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d09634-adf5-483e-8ee8-27615611634a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.966466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d09634-adf5-483e-8ee8-27615611634a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.966466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d09634-adf5-483e-8ee8-27615611634a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:15.966466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 206/403] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:15.969212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d09634-adf5-483e-8ee8-27615611634a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:15.973467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-15fd7dc9-d2f6-41f9-b9ec-2600de9e4165 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:15.981793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:15.982789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:15.983597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 198/404] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:15.984780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:15.984952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:15.990608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.006722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:16.007928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:16.084268 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 199/405] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:16.085135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.141822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d09634-adf5-483e-8ee8-27615611634a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.185076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.185965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.186248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.186517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.190545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, group_id=792d7e199fbd48bfa22bf931c9c3d664, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.192026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.214295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2dd72f-9b8a-4f02-a71c-188cf9444d05 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.214833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 207/406] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 17 17:59:15 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 17:59:16.215626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.254919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.257107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.257633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.258143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.259328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:16.260702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.262391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.274776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 200/407] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:16.281446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.337522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00032281-b77a-4870-b3c6-aea492709cf8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.375807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.376637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.376974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.377253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.389842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:16.399856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:16.400842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:16.401660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 208/408] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:16.407445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.414391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaaaff-db6d-40d1-88df-450b8239a208 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.475472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.476722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.477199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.477695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.479289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.480931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.483113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 201/409] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:16.488373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.533314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a7b58-5e59-460c-995c-e97ca2c3bb6f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.571044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.571765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.572049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.572324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.573082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:16.573387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.578598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.585999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 209/410] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:16.591843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.652738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61762aa9-d2ee-44ad-8126-0c9e9ad0d2a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.691568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.692816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.693294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.693786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.695577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.697229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.697973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d6f8c3-a2de-4e13-8f68-febaa259e302 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.699729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 202/411] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:16.707262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.742716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.742716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.742716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.742716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] PATH_INFO: `/v3/groups/0e0833fb4580401aa6d499ad851fa448` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.743080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] RBAC: Authorizing `identity:get_group(group_id=0e0833fb4580401aa6d499ad851fa448)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.743080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.745374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 210/412] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/groups/0e0833fb4580401aa6d499ad851fa448 => generated 229 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:16.756119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:16.824436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d7f9e-f098-48f6-8bda-50340fdf1280 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.858338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.859630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.860103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.860584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.863041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] RBAC: Authorizing `identity:create_grant(project_id=a891da2b320f4003804e7f14c8964606, group_id=792d7e199fbd48bfa22bf931c9c3d664, role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.865371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.887269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 203/413] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 17 17:59:16 2022] PUT /identity/v3/projects/a891da2b320f4003804e7f14c8964606/groups/792d7e199fbd48bfa22bf931c9c3d664/roles/6aada032643443b8a7ee169eadfab258 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:16.934815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215a786-1a0e-46b2-af0c-6ea8d2c5a896 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:16.979456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:16.980401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:16.980684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:16.980961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] PATH_INFO: `/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:16.982814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] RBAC: Authorizing `identity:get_project(project_id=ce77dde206fe428ba1cf2d3583c7c4a2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:16.984371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b65830-5a54-407c-ab04-6c402188977e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:16.986365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 211/414] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:16 2022] GET /identity/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2 => generated 344 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:16.992989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:17.106826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab7ee4-e0ff-4970-a4c3-c1dfe5f0fcdd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:17.131649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb4f9d-08de-451f-ae17-5d98fe479735 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.131960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb4f9d-08de-451f-ae17-5d98fe479735 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.132194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fb4f9d-08de-451f-ae17-5d98fe479735 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.133988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 212/415] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:17.147062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.147678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.147770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.152004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:17.153097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.153527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.153956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] PATH_INFO: `/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2/groups/0e0833fb4580401aa6d499ad851fa448/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.160139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] RBAC: Authorizing `identity:create_grant(project_id=ce77dde206fe428ba1cf2d3583c7c4a2, group_id=0e0833fb4580401aa6d499ad851fa448, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:17.161686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:17.170156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:17.173160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:17.191757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 204/416] 10.222.0.25 () {58 vars in 1442 bytes} [Tue May 17 17:59:16 2022] PUT /identity/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2/groups/0e0833fb4580401aa6d499ad851fa448/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:17.262384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 213/417] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:17.303832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:17.436798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb256d64-f40c-48b1-acca-b896341fe24a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:17.472597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:17.473633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.474759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.475231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.488252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:17.496720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:17.497829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:17.498971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:17.501374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 205/418] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:17.510215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:17.663440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e064dd-4529-4ecb-830a-f13712639c79 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:17.710583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:17.711265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.711552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.711825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.712572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:17.712874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:17.714237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e5480-ca82-4253-be92-8e91f13d0621 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:17.727847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 214/419] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:17.732881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:17.832375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27251-5829-4fb7-aa7d-f6d77fa4e691 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.832659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27251-5829-4fb7-aa7d-f6d77fa4e691 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.832936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e27251-5829-4fb7-aa7d-f6d77fa4e691 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.835264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 215/420] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:17.840704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.841254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.841746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.874616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82970a14-c91c-42d9-bd73-511d7e94fb2c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:17.879569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:17.881704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:17.905848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:17.906560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:17.906868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:17.907143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:17.998153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 216/421] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:18.023542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.025070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.043691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.124923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 206/422] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:18.135568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.152990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af21b34b-3475-44ab-abb8-2628e9c3dd27 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.188239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.189073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.189358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.189633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.200894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:18.209483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:18.210430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:18.211270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 217/423] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:18.224067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.249351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25054c-b809-4747-a219-fb5cc2cbe3dd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.284067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.284943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.285226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.285501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.286877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.288314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.290369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 207/424] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:18.296938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.398804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0bb2e-9df9-42ab-a657-6d4624882e75 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.402226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615177b-a0b4-4cdd-ad83-ff961a00845c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.436148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.437111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.437397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.437673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.439181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.440555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.442507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 208/425] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:18.447360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.448033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.449051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.449830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.450113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.452784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:18.453099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.459721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.472792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 218/426] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:18.496858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:18.632466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edb130d-6adc-41d9-952b-961b33ab2f1c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.647318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc36a-2f8b-4cb1-8cbc-384804a662b5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:18.699813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.700611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.700897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.701170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.703445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=c35882aa340145a790db6ed86cf9a294) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:18.703765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.705005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:18.705219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.705660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:18.705939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:18.706212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:18.720200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 209/427] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 611 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:18.805755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:18.807259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:18.939529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 219/428] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:18.945109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.050210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f63861-17fa-409a-989f-5ed907c638ce None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:19.085548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:19.086439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.086747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.087023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] PATH_INFO: `/v3/projects/c35882aa340145a790db6ed86cf9a294` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.088265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] RBAC: Authorizing `identity:get_project(project_id=c35882aa340145a790db6ed86cf9a294)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:19.089834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:19.091624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 210/429] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:18 2022] GET /identity/v3/projects/c35882aa340145a790db6ed86cf9a294 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:19.097416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.214888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec355e15-4ec1-44b5-b544-daf9ad5771ca None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:19.249755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:19.250707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.250990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.251261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.252455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:19.254015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f79f5f-560e-47ef-bf65-756fb9293055 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:19.256863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 220/430] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:19 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:19.262369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.343951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61039-c978-4ca1-849d-4d613e1a7d18 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.344243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61039-c978-4ca1-849d-4d613e1a7d18 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.344439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc61039-c978-4ca1-849d-4d613e1a7d18 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.345804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 221/431] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:19.353080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.353664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.354149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.376515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d30d92-a82d-4760-890d-b35b24c7d664 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:19.378317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:19.379893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:19.431555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:19.432227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.432512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.432787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.434131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=c35882aa340145a790db6ed86cf9a294) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:19.434473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:19.435946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:19.446664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 211/432] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:19 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=c35882aa340145a790db6ed86cf9a294&role.id=6aada032643443b8a7ee169eadfab258 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:19.480948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 222/433] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:19.504487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.623121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e8c4c-9732-4b9b-93d8-9df464734251 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:19.673633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141755c1-2506-472c-babf-a070912e6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:19.674930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141755c1-2506-472c-babf-a070912e6883 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.675422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141755c1-2506-472c-babf-a070912e6883 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.675896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141755c1-2506-472c-babf-a070912e6883 None admin] PATH_INFO: `/v3/roles/member` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.687775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141755c1-2506-472c-babf-a070912e6883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-141755c1-2506-472c-babf-a070912e6883 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:19.696889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:19.697837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 17 17:59:19.698692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:19.699327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 212/434] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:19.705207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.837219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24269c10-590b-4763-bd40-5c349acc2893 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:19.856974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247cb7-1fab-4523-bf39-ebd16e27a4e4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.857582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247cb7-1fab-4523-bf39-ebd16e27a4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.858075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5247cb7-1fab-4523-bf39-ebd16e27a4e4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.859631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 213/435] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:19.868873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2057f-7057-4585-8cfd-8e33aad0a5ef None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.869156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2057f-7057-4585-8cfd-8e33aad0a5ef None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.869432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c2057f-7057-4585-8cfd-8e33aad0a5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.874732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:19.875349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.875629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.875899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.876636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] RBAC: Adding query filter params (name=member) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:19.876930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:19.878636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:19.890643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-29c2057f-7057-4585-8cfd-8e33aad0a5ef None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:19.890954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 223/436] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 17:59:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:19.891164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-29c2057f-7057-4585-8cfd-8e33aad0a5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:19.898983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:19.978664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 214/437] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:19.980085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd842-e576-4b5a-b526-7b3bb86168b9 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.980361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd842-e576-4b5a-b526-7b3bb86168b9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.980642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd842-e576-4b5a-b526-7b3bb86168b9 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:19.982109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 215/438] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:19.987213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:19.987504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:19.987813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.008212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:20.009377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:20.018478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b8c7f-19cd-4847-a30b-4bf2bd8badc5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.053270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.053921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.054202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.054473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.077845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 216/439] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:20.078697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.119414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.120842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.170273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22380cc-9703-40cc-bafc-0e3ac32491f3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.202887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.203680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.203960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.204239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.212139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 224/440] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:59:20.213031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.216596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:20.224884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:20.226015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 217/441] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:20.227224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.308016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cd062-81ed-439c-ac83-1cb449eb3881 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.319462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b99e01-d3df-42bb-b491-d2dec81ca541 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.340606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.341413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.341704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.341958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.350592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.351434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.351706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:20.351798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.351975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.353133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.354605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.356262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 218/442] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:20.357008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:20.359853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:20.360729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:20.361533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 225/443] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:20.362203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.452012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b80a98-adb3-42a9-bbd4-044947d99845 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.455523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7aaa0-8de7-47b9-9762-48cc39b81561 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.483779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.484431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.484713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.484986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.485713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:20.486016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.487297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.487404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.488130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.488406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.488672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.490408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.491851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.493453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 226/444] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:20.494193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.504584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 219/445] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:20.504584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.585245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa67fe-f377-433b-9ed2-a727d055390b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.596238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a682230-e69a-4215-aae3-377954eac9de None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.616255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.616911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.617185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.617456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.618183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:20.618490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.619864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.627287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 227/446] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:20.628013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.628384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.629037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.629323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.629597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.630703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=56e6612f0b624b24b14d5d60b68b2ceb, scope.project.id=a891da2b320f4003804e7f14c8964606) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:20.631016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.632462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.638245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 220/447] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=56e6612f0b624b24b14d5d60b68b2ceb => generated 611 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:20.639051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.734707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71970d-20db-454d-ae81-bb69c85c4d33 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.770556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.771150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786758f-a9c9-46b0-925b-bcdab69e7792 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:20.771399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.771679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.771959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.807287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:20.808103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:20.808401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:20.809485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:20.843377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.844826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.882885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:20.885338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:20.962952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 228/448] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:20.968939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:20.991135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 221/449] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:20.997693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:21.072292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab2660-f2c8-4216-aefa-c841d16335a5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.098491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6afadd2-2ce7-4e0b-ad85-08b2758c0439 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.103931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.104786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.105065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.105330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] PATH_INFO: `/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.106489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] RBAC: Authorizing `identity:get_project(project_id=ce77dde206fe428ba1cf2d3583c7c4a2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.107930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.109591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 229/450] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/projects/ce77dde206fe428ba1cf2d3583c7c4a2 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:21.115518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:21.131535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.132394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.132674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.132947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] PATH_INFO: `/v3/projects/a891da2b320f4003804e7f14c8964606` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.134110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] RBAC: Authorizing `identity:get_project(project_id=a891da2b320f4003804e7f14c8964606)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.135579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.137265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 222/451] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 17:59:20 2022] GET /identity/v3/projects/a891da2b320f4003804e7f14c8964606 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:21.142484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:21.209692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b151a8ea-0ac3-446f-878a-fe4b5772ad2d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.234725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e63bdaf-69cb-4c9a-8d9d-1a23e0ae8872 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.241722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.242499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.242805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.243077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] PATH_INFO: `/v3/groups/0e0833fb4580401aa6d499ad851fa448` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.244227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] RBAC: Authorizing `identity:get_group(group_id=0e0833fb4580401aa6d499ad851fa448)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.245646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.247259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 230/452] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:21 2022] GET /identity/v3/groups/0e0833fb4580401aa6d499ad851fa448 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:21.252948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:21.265918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.266792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.267070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.267340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] PATH_INFO: `/v3/groups/792d7e199fbd48bfa22bf931c9c3d664` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.268499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] RBAC: Authorizing `identity:get_group(group_id=792d7e199fbd48bfa22bf931c9c3d664)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.269920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.272253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 223/453] 10.222.0.25 () {56 vars in 1180 bytes} [Tue May 17 17:59:21 2022] GET /identity/v3/groups/792d7e199fbd48bfa22bf931c9c3d664 => generated 226 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:21.277781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:21.347017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1c79fd-528d-4541-aa25-36f6ac1b33fc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.370219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60edd3f-8eae-4821-8a0f-08913a84833b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:21.378486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.379159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.379431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.379698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.380548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] RBAC: Adding query filter params (group.id=0e0833fb4580401aa6d499ad851fa448, role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=ce77dde206fe428ba1cf2d3583c7c4a2) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:21.380851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.382260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8e3924-d90f-4286-b022-ea6dd6c6d81a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.387791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 231/454] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:21 2022] GET /identity/v3/role_assignments?group.id=0e0833fb4580401aa6d499ad851fa448&scope.project.id=ce77dde206fe428ba1cf2d3583c7c4a2&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 611 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:21.405137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:21.405824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:21.406109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:21.406383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:21.407267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] RBAC: Adding query filter params (group.id=792d7e199fbd48bfa22bf931c9c3d664, role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=a891da2b320f4003804e7f14c8964606) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:21.407585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:21.409102 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb554100-5d24-4003-91a5-022ee96668ea None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:21.417096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 224/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue May 17 17:59:21 2022] GET /identity/v3/role_assignments?group.id=792d7e199fbd48bfa22bf931c9c3d664&scope.project.id=a891da2b320f4003804e7f14c8964606&role.id=6aada032643443b8a7ee169eadfab258 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:24.368376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d302-6bb3-4ff0-b2fb-b7ce5c32e9d6 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.368932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d302-6bb3-4ff0-b2fb-b7ce5c32e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.368932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4d302-6bb3-4ff0-b2fb-b7ce5c32e9d6 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.370526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 232/456] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:24.378603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd0a8-f1e8-4d03-be2a-cce48c8509e5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.379114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd0a8-f1e8-4d03-be2a-cce48c8509e5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.379213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cd0a8-f1e8-4d03-be2a-cce48c8509e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.403647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1f3cd0a8-f1e8-4d03-be2a-cce48c8509e5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:24.404841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f3cd0a8-f1e8-4d03-be2a-cce48c8509e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:24.495390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 225/457] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:24.533115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4d302-6bb3-4ff0-b2fb-b7ce5c32e9d6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:24.671288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4d302-6bb3-4ff0-b2fb-b7ce5c32e9d6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:24.720159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:24.720958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.721235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.721499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.734119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985137-cd4b-433d-aca5-2ecfeeb368a2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.734298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:24.734858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985137-cd4b-433d-aca5-2ecfeeb368a2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.735337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985137-cd4b-433d-aca5-2ecfeeb368a2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.735724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:24.737565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 226/458] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:24.743430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4abd-638b-41f2-a64e-7184364d8ea5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.743951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4abd-638b-41f2-a64e-7184364d8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.744431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b4abd-638b-41f2-a64e-7184364d8ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:24.763451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:24.764373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:24.765244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:24.765244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:24.765244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:24.765244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:24.770667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 233/459] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:24.773739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4c1b4abd-638b-41f2-a64e-7184364d8ea5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:24.774365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:24.782620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4c1b4abd-638b-41f2-a64e-7184364d8ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:24.851574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 227/460] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:24.853174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1d81-2389-4e6b-bb0a-e9cd6c8c2051 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.853633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1d81-2389-4e6b-bb0a-e9cd6c8c2051 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.854076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c1d81-2389-4e6b-bb0a-e9cd6c8c2051 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.855776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 228/461] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:24.862629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890848f-5171-4edf-8993-202ec06b074c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.863200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890848f-5171-4edf-8993-202ec06b074c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.863673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a890848f-5171-4edf-8993-202ec06b074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.887197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a890848f-5171-4edf-8993-202ec06b074c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:24.887382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d21325d-b1a7-4e18-a67b-5a882eb7c4fa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:24.888370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a890848f-5171-4edf-8993-202ec06b074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:24.919448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:24.920111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.920393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.920668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.921438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:24.921693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:24.923105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b12a7-ab30-4392-985a-afe53e7209f4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 234/462] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922bbd-ec9a-4b0c-b14a-9a604e36fec8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922bbd-ec9a-4b0c-b14a-9a604e36fec8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59922bbd-ec9a-4b0c-b14a-9a604e36fec8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 235/463] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:24.940952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922bbd-ec9a-4b0c-b14a-9a604e36fec8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:24.966825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 229/464] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:24.967819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890848f-5171-4edf-8993-202ec06b074c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.049924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59922bbd-ec9a-4b0c-b14a-9a604e36fec8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.074011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a890848f-5171-4edf-8993-202ec06b074c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.082909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.084796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.085082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.085365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.095296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.096942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.108527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.109484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.109957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.110421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.111493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.113137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e685438f-8f33-47b1-bf1e-299bcd2c34ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:25.115857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:25.116720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 236/465] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.122757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.137545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:25.138599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 230/466] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:24 2022] POST /identity/v3/users => generated 248 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:25.139288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:25.139491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.229098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 237/467] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:25.230027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.268602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7144ffc3-3321-4052-9740-605447f6f021 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.312954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.314058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.314345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.314654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.330323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.332134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.349694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a4895-9710-41c3-afd2-0cfef725d60a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:25.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:25.357122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:25.358719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:25.358719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:25.358719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.358719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:25.358719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 231/468] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:25.359028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.393434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.394269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.394373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.394780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.395756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:25.395875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.397202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.408839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 238/469] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:25.410135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.497227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a2bbe-193e-46d0-959a-ad0c549ca4dd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.529004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82810fe6-06cd-49a7-a4c2-a5a8f5a48e7b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.530843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.531644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.531924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.532200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.543874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.545401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.563607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:25.563935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:25.564805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:25.565701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:25.565701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:25.565701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:25.565701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:25.565927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.565927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.565927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.566109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 232/470] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:25.566174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:25.566174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.566298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.567167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66d0df-00bd-4f7f-99a9-84abc91c8d22 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.579082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 239/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:25.580501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df329-f45f-4194-b05f-0e9d0b0593fb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.580787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df329-f45f-4194-b05f-0e9d0b0593fb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.581060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6df329-f45f-4194-b05f-0e9d0b0593fb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.582617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 240/472] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:25.583244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6df329-f45f-4194-b05f-0e9d0b0593fb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.683586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9089b3fc-593d-4180-a5ee-8b41ed7af0ed None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.689127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6df329-f45f-4194-b05f-0e9d0b0593fb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.716904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.717572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.717855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.718129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.718865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.720303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b40718b-254c-4adf-9fae-44188b995bee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.724351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.725027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.725310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.725584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.726298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:25.726628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.727995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.741153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 241/473] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:25.741153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.746644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 233/474] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:25.748136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.748553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.748969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.779236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:25.780996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:25.866787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d41e3-912c-446c-863c-2c0cb08d6795 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:25.873743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 234/475] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:25.874822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:25.914337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:25.915207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:25.915597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:25.915980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:25.916824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:25.918373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:25.945716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 242/476] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/users => generated 248 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:25.946851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:26.016937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee3a96-dff4-4538-8340-cba050e3ef18 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:26.066124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:26.066963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:26.067686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:26.067977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:26.068996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:26.071062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:26.073615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f029d-037a-48db-bace-bef3a8a66454 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:26.098897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 235/477] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/users => generated 249 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:26.119241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:26.119940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:26.120218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:26.120492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:26.121271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:26.122746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:26.133850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.sql.core [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 17:59:26.133850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 17:59:26.133850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [parameters: {'id': '1868b8cd50ec4dc4842a95e326ee5a0d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 17:59:26.133850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79967) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result = self._query(query) May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application conn.query(q) May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result.read() May 17 17:59:26.151306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return ref.to_dict() May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 17:59:26.152286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application next(self.gen) May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application yield resource May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application next(self.gen) May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.session.rollback() May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.force_reraise() May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise self.value May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application session.commit() May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 17:59:26.153285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._prepare_impl() May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.session.flush() May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._flush(objects) May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application compat.raise_( May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application flush_context.execute() May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rec.execute(self) May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 17:59:26.154192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 17:59:26.155104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result = self._query(query) May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application conn.query(q) May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result.read() May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 17:59:26.157063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [parameters: {'id': '1868b8cd50ec4dc4842a95e326ee5a0d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:26.158967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 17 17:59:26.160934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:26.167982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 243/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 17 17:59:25 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:26.168122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:26.283728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3609200d-ec47-46b1-8c23-e1433069d817 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:26.322692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:26.323553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:26.323834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:26.324107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:26.334493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-08ee8386-0288-4dea-815e-799f1b3b2a76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:26.342684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:26.344774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:26.346759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 236/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 17:59:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:26.351545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:26.455950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc408cc8-6f14-48d2-89dc-6ce02987565e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:26.491643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:26.492316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:26.492587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:26.492857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:26.493601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:26.493902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:26.495292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1176b834-b867-44b7-902c-4ccb7abe523c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:26.508140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 244/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:27.782754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d89c0-6c78-4489-8b53-cf1dab7b35de None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:27.783478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d89c0-6c78-4489-8b53-cf1dab7b35de None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:27.783478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d89c0-6c78-4489-8b53-cf1dab7b35de None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:27.784888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 237/481] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:27.791116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:27.791532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:27.791669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:27.813713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:27.815184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:27.891456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 245/482] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:27.926011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d89c0-6c78-4489-8b53-cf1dab7b35de None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.068336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d89c0-6c78-4489-8b53-cf1dab7b35de None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:28.110863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:28.111674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.111956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.112226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.126300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:28.134305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:28.135281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:28.136116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 238/483] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:28.141200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.282689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b18ec-b5bf-4457-8a3b-b230ecbf6588 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:28.326068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:28.327140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.327628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.328123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.329075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:28.329595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:28.331182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:28.340688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 246/484] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:28.347707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.501121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bc4516-f7a0-42f9-a351-8d38742be5f2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:28.547426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:28.548234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.548514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.548784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.565105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:28.566630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-cdd93ab8-b125-49ff-b679-7781c450f697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:28.591022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:28.592399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:28.593716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:28.593716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:28.593716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:28.593716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:28.593716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 239/485] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:28.597956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.700913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b160d-ec98-4dc1-a3e7-d641b9ea30f3 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.701235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b160d-ec98-4dc1-a3e7-d641b9ea30f3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.701462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b160d-ec98-4dc1-a3e7-d641b9ea30f3 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.703190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 240/486] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:28.711957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6a71-c3b3-4e2b-9343-7360a63f0bc7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.712243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6a71-c3b3-4e2b-9343-7360a63f0bc7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.712514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6a71-c3b3-4e2b-9343-7360a63f0bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.736412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a853c5-168a-4b67-894d-890852939ad2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:28.747964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9d0e6a71-c3b3-4e2b-9343-7360a63f0bc7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:28.749149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9d0e6a71-c3b3-4e2b-9343-7360a63f0bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:28.772485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:28.773154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.773437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.773712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.774429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:28.774766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:28.776122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023a7f64-267d-4784-85c6-83bb0c79a1fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:28.788145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 247/487] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:28.789468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177a25-4c2a-4509-b45d-955f55985a97 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.789758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177a25-4c2a-4509-b45d-955f55985a97 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.790035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a177a25-4c2a-4509-b45d-955f55985a97 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.791525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 248/488] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:28.796154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a177a25-4c2a-4509-b45d-955f55985a97 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.820679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 241/489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:28.822616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90073e4-997e-4532-8833-70734a38740d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.823040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90073e4-997e-4532-8833-70734a38740d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.823452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90073e4-997e-4532-8833-70734a38740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.841291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e90073e4-997e-4532-8833-70734a38740d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:28.842773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e90073e4-997e-4532-8833-70734a38740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:28.903086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a177a25-4c2a-4509-b45d-955f55985a97 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:28.913954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 242/490] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:28.915095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90073e4-997e-4532-8833-70734a38740d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:28.938644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:28.939412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:28.939885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:28.939998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] PATH_INFO: `/v3/users/glance` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:28.948154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:28.949939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:28.966756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:28.967846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:28.969115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 249/491] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:28.969884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.024928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90073e4-997e-4532-8833-70734a38740d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.059613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.060656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.061074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.061525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.072466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630ca49-68ba-4bcb-b719-f8f24c729c0c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.073073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:29.081065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:29.081987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.083089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:29.084227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 243/492] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:29.084616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.110127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.110872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.111157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.111430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.121763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-eb79d08d-4f21-43ba-8f51-a95ec6d2dcf1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:29.129502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:29.130995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:29.132453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 250/493] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:29.133124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c020-cfed-4be0-8998-e3dd1317f557 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.133124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c020-cfed-4be0-8998-e3dd1317f557 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.133449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7c020-cfed-4be0-8998-e3dd1317f557 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.134848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 251/494] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:29.135347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7c020-cfed-4be0-8998-e3dd1317f557 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.191937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46ec07-8fca-4f70-b420-978248818668 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.226212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.226883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.227170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.227455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.228292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:29.228606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.230054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.237297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7c020-cfed-4be0-8998-e3dd1317f557 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.267964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 244/495] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:29.268804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.274685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.275362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.275642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.275914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.276663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:29.276962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.278331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed602cf2-594b-49a1-81bf-73a4168ce3d9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.291580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 252/496] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:29.291580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.291580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.291580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.307112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:29.308260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:29.382685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 253/497] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:29.382858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e509b4-133c-4abb-b7a9-8ca0a4685062 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.382968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.419593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.420352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.420631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.420906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.421636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:29.421951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.423340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.431351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 245/498] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:29.432051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.479354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61319cd7-022c-48f3-8800-b0b7d13d3fe5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.515268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.515993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.516279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.516559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.541783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091de96-59ce-4681-b28a-b14067adf5c5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.574501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.575325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.575606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.575879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.580979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.582420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.587405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.588852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:29.605493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:29.606413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 246/499] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:29.612456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.686543 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 254/500] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:29.687408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.710932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74974306-8406-4bd4-8f77-a5c17d7b6672 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.742576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.743384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.743664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.743937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.753717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:29.761957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:29.763087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:29.763927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 247/501] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:29.764628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.786823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dbba6-b1b2-443b-a819-dfd5abd78ad2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.819963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.820746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.821034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.821299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.830957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.832406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-471bb2a3-cfc7-42eb-ab30-962f2ba426be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:29.850061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:29.850969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:29.851839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:29.851839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:29.851839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:29.851839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:29.851839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 255/502] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:29.852538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81050c72-4f1c-4577-8b73-053846dc2566 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.852850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81050c72-4f1c-4577-8b73-053846dc2566 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.853107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81050c72-4f1c-4577-8b73-053846dc2566 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.854460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 256/503] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:29.858598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81050c72-4f1c-4577-8b73-053846dc2566 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.858717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed8561b-ad14-4dc3-b1b2-f6f8b1cfa666 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.890354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.891037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.891320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.891593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:29.892298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:29.892650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:29.894059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:29.905339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 248/504] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:29.906111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:29.959097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81050c72-4f1c-4577-8b73-053846dc2566 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:29.994247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:29.995074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:29.995356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:29.995628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.002072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e80e-2374-4e3b-9399-a06f6631cee7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.005701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.007191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:30.024423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.025344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.026209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:30.026209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:30.026209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.026209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:30.026209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 257/505] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.026481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.038503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.039238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.039494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.039764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.040491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.040788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.042146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a209ffb-5b8f-4aff-b38a-7721d0c324a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.049815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 249/506] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.051027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.051309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.051659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.067820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:30.068886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:30.122628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4364cd4e-7656-44b7-ac23-fac946275ea5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.130505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 250/507] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:30.131416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.158199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.158896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.159193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.159454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.160177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.160482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.162478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.173201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 258/508] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.173988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.232098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cee0dcc-fdf7-4f1d-be9e-e1050fd6650e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.264549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.265333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.265609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.265875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.266862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c97a728-e695-4e11-b708-34624f0bfc8a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.272678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.274133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:30.289193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.290226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 251/509] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.291569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.303135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.303828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.304102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.304374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.305088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.305391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.306785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.318890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 259/510] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.319674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.384901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122c7d-568a-4056-90ea-147c94ee32f8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.410314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e498b756-0a70-41c7-a82f-257b2bb4b7e8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.417636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.418422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.418738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.419013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.428465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.429925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.443086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.443876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.444159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.444432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:30.446960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.447770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.448635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:30.448635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:30.448635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.448635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:30.448635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 252/511] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.449423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.454059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.455545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:30.474139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.475063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.475918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:30.475918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:30.475918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:30.475918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:30.475918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 260/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.476193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.545569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05147686-32da-451a-aa72-84adaace56d3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.569020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf8116-6794-4cfc-93cc-3df18c148d82 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.577831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.578652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.578944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.579216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.586813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.588258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.600767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.601421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.601700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.601970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:30.602401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.603376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:30.604339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:30.604888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.604888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.605010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 253/513] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.605010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.605139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.640428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 261/514] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.641149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.697906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf752a0-3891-470b-950a-75e7e7f5b323 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.731409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.732197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.732476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.732750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.736155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5810d9-0385-434a-baf5-a98a5d6ebc83 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.739339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.740782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:30.755360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:30.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:30.757132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:30.758967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 254/515] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:30.759548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.768163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.768821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.769100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.769375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.770088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.770995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.772560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.783199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 262/516] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.783966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.854203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c2a68-c45a-4813-b90f-881bd433e857 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.874696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699318d-1c78-4d99-96e1-9499580678a8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:30.885751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.886407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.886726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.887001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.887712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.888019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.889388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.901051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 255/517] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.901830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.907110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:30.907780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:30.908063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:30.908339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:30.909169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:30.909484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:30.911458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:30.929023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 263/518] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:30.929846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:30.998190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25de8d6e-2535-48bd-96d6-1dad1e37ac98 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.023869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256dc70-8ba0-47eb-8614-29349830c538 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.030694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.031341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.031623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.031897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.055842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.056505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.056784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.057092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.057872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:31.058175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.059629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.078385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 264/519] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:31.079292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.095474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.096931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.170168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d1cc4-cda7-4f8a-870b-d718fe9fd14f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.187456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 256/520] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:31.188519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.203141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.203938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.204253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.204524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.211761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.213192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:31.227454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:31.228379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:31.229286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 265/521] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:31.229865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.282870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d161ed-3d3c-4179-b119-54002b5c54b4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.315351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.316014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.316294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.316567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.317284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.318887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.323009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38a930-9db0-4906-84c7-00335b4ec4ff None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.338016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 257/522] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:31 2022] POST /identity/v3/users => generated 247 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:31.338825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.358275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.358988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.359270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.359542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.431565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.433084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.454811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849e2ad-e0be-4d78-8185-f94d25db3b1a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.490221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.490937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.491296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.491490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.492327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8730a384ede5490eaa8e818e7c60518d) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:31.492637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.494173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.500126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 258/523] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/role_assignments?user.id=8730a384ede5490eaa8e818e7c60518d&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:31.501284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.540734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 266/524] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:31.542857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.639590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7532624-233f-423f-ae33-c464942e63d3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.657754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8517ab8e-5a16-46f4-9155-b074819bb0eb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.676146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.677059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.677343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.677617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.689550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.690994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.696481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.697205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.697494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.697769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.698646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:31.698959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.700412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:31.710636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:31.711514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:31.712375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:31.712375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:31.712375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:31.712375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:31.714628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 259/525] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:31.715725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.724142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 267/526] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:31.725078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.815890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d7fb1c-3118-48ff-b1dc-b1f34c6dd7cf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.826853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68332d4-e575-4c40-9806-d82e4e99a7fb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:31.850308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.851448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.851925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.852386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.860903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:31.861671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:31.861956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:31.862229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:31.862984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:31.863288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.865305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.865977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:31.867657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:31.877291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 268/527] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:31.878325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:31.886077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:31.887270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:31.888151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:31.888151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:31.888151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:31.888151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:31.890335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 260/528] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:31.891347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:31.991293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1d00-8b4c-4767-aae6-c19f6d68e26f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.000785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f99168-5900-4697-9ed8-dbb522b9552c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.025497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.026125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.026406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.026712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.038266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.039417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.039894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.040392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.047357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:32.063729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:32.064594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.065471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:32.067951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 261/529] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:32.068930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.097552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.099475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.166315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99363f-cfea-4f2c-b46e-e53aba9deb5d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.200604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.201600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.202095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.202559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.202706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 269/530] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:32.203558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.203807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.204297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.205848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.218052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 262/531] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:32.219221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.309297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231107e-1caa-427c-bd34-6963227b533c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.318432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eedbcd4-d846-4c63-b3fa-44a80b66ec96 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.343810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.344477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.344757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.345028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.345807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.346110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.347562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.354170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.355282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.355760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.356227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.360130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 270/532] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:32.361117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.367901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.369611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:32.387279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:32.388166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:32.389029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:32.389029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:32.389029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:32.389029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:32.390925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 263/533] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:32.391883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.465296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b967e90-99b9-4123-900a-d0ccd651e04d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.488237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9581294-3260-4e0a-a332-c1dddd37b1e5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.499177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.500092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.500270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.500527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.507401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.508865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:32.524269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:32.525174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.526047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:32.527326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.528195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.528666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.529140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.530155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 271/534] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:32.530259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.530767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.531030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.532937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.539356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 264/535] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:32.540483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.640380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77d077-ee06-4890-9bb8-3fb507c4ced3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.646553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5e20c-5867-4886-933d-20b7a2d9c015 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.676939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.677669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.677948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.678277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.679038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.679341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.680743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.684176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.685101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.685595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.686061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.687064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.687565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.689451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.697716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 272/536] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:32.699131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.710548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 265/537] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:32.730272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.818602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b96221-d345-4808-8304-d6eb0de9d0ba None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.850763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.851566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.851846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.852114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.871518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.872974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.877295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6247f13f-b9ba-4350-bc2e-0fc5e0bf0928 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:32.899464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:32.900686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:32.901595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:32.904076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 273/538] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:32.909568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:32.918470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:32.918470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:32.918470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:32.918470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:32.919169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=d4fbd6d1978f41e1af28e18d26395767) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:32.919169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:32.919616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:32.927257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 266/539] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/role_assignments?user.id=d4fbd6d1978f41e1af28e18d26395767&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:33.028184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222d1a67-7b66-4a90-b2d9-cd47d4ae05b0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:33.070853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:33.071820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:33.072253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:33.072677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:33.073623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:33.074078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:33.075699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89c56d-ac13-4cb4-be10-b453ebce427a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:33.096904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 274/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:33.103549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:33.225727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9eaa17-5375-4685-9306-7fa5174262a6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:33.266079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:33.267151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:33.267642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:33.268131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:33.269159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=0292f8e2e5ff4fe8939c078d01993ea1) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:33.269690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:33.271916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d210a-2f5f-4a6d-a2a5-1fd2104c450b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:33.278412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 267/541] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:33 2022] GET /identity/v3/role_assignments?user.id=0292f8e2e5ff4fe8939c078d01993ea1&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:33.752942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361bec6-af9c-453b-8e8f-128485465f5f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:33.753645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361bec6-af9c-453b-8e8f-128485465f5f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:33.754140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9361bec6-af9c-453b-8e8f-128485465f5f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:33.756549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 275/542] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:33.762105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:33.762685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:33.763173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:33.780896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:33.782495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:33.852199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 268/543] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:33.875623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361bec6-af9c-453b-8e8f-128485465f5f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:33.981015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9361bec6-af9c-453b-8e8f-128485465f5f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.015146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.015868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.016152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.016429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.027286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:34.035125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:34.036134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:34.037366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 276/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:34.042474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.150785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17eed7-040f-4095-9b5d-f555b318fc28 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.185354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.186045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.186329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.186628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.187377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:34.187685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:34.189351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:34.198119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 269/545] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:34.203551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.305287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065939d8-cf1c-4b23-9ec8-7fcdbedde750 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.339722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.340518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.340802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.341077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.352012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:34.353466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-3cd59603-cbcb-400b-a26b-b27ff3ab8a22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:34.370762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:34.372878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:34.375061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:34.375061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:34.375061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:34.375061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:34.375061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 277/546] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:34.377704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.396067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ef36-23df-4f5b-907e-c36620c19891 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.396352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ef36-23df-4f5b-907e-c36620c19891 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.396619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb9ef36-23df-4f5b-907e-c36620c19891 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.398472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 278/547] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:34.405973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.406264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.406541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.445051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:34.446271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:34.524878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f00ef-984f-4b09-bf66-1a16a6d61d35 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.559876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.560472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.560755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.561032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.566594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:34.566594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:34.566594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:34.577033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 270/548] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:34.582371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.600491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 279/549] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:34.634156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.735085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d6c7d-d78d-4dad-b947-0ae8ecd043fe None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.770207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f801717-e328-4811-aa46-608fe3841f46 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.773598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.774408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.774725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.775006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.785330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:34.793663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:34.794609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:34.795847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 280/550] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:34.800660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.867952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.869105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.869604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.870089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.877835 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:34.879624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:34.895422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:34.896384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:34.897298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:34.899982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 271/551] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:34.905758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b012c8-3b6c-4a43-b563-8dd71d79d6de None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:34.906834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:34.941959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:34.943720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:34.944004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:34.944277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:34.945025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:34.945331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:34.946769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:34.955244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 281/552] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:34.961611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.069405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e2aa1a-786e-4b10-9f65-203b07899319 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.128495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137461c-6769-4579-85c5-ff26782b3038 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.142343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.143233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.143514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.143786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.144622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:35.144931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.147863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.181072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 272/553] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:35.184917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.185806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.186092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.186365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.187788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.212139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.213605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:35.252870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:35.253845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:35.256427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:35.256427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:35.256427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:35.256427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:35.256427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 282/554] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:35.260513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.368029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fdb5f7-7ca6-4cb1-a726-5fdf3d54390c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.402810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.403388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.403736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.404013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.472726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.474414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3f249a-fabe-4b44-ae27-8e2c92a9fbe8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.486288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee90243-6637-4af4-8bd3-9f20a323c675 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.555686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.557122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.557563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.558263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.559324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:35.559779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.561584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.577428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 273/555] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:35.582260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c676-5628-499c-8f71-7e421bee983e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.582260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c676-5628-499c-8f71-7e421bee983e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.582260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558c676-5628-499c-8f71-7e421bee983e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.583831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 283/556] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:35.586601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.586716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 274/557] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:35.589034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.589322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.589596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.607146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:35.608367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:35.678448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 275/558] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:35.679416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.701713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b25b12-e6c3-4ac0-92b2-2781f2d31da7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.737994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.739954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.740454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.740932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.752664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.755158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:35.774843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:35.775852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:35.776708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:35.776708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:35.776708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:35.776708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:35.778999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 284/559] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:35.783436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25dec1c-62a7-48f9-8ec5-e4594e10524a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.784537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.818081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.818931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.819213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.819486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] PATH_INFO: `/v3/users/glance` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.826997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.828464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:35.843574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:35.844513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:35.845443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 276/560] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:35.846022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.887473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752dbabc-f02b-4830-8b42-fd1380f8d950 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.925627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.926483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.926884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.927218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.937869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4b3ec65f-3429-4cee-b6b3-e969200f6de8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:35.946822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:35.947903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:35.949696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:35.950834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a62e8-fab4-4e0d-870d-e7cf6832600b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 285/561] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd081b-7af0-4bbf-bb97-d1238d18a06d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd081b-7af0-4bbf-bb97-d1238d18a06d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd081b-7af0-4bbf-bb97-d1238d18a06d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 286/562] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:35.952525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd081b-7af0-4bbf-bb97-d1238d18a06d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:35.987148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:35.987847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:35.988133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:35.988411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:35.989221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:35.989528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:35.990950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c507792-359e-4bcd-b8eb-02b349726fd2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.001839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 277/563] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.003097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fb3a-4572-4b28-a1d0-a44a82530212 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.003385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fb3a-4572-4b28-a1d0-a44a82530212 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.003661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403fb3a-4572-4b28-a1d0-a44a82530212 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.005495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 278/564] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:36.006182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403fb3a-4572-4b28-a1d0-a44a82530212 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.053703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd081b-7af0-4bbf-bb97-d1238d18a06d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.086029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.086722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.087001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.087272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.088085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.088387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.089796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43dddc3-5d09-4086-9e88-215f0113aef5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.102418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7403fb3a-4572-4b28-a1d0-a44a82530212 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.106420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 287/565] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.107740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286d81-3288-43c4-9e84-054ef6f109eb None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.108032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286d81-3288-43c4-9e84-054ef6f109eb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.108308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3286d81-3288-43c4-9e84-054ef6f109eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.123971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b3286d81-3288-43c4-9e84-054ef6f109eb None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:36.125153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b3286d81-3288-43c4-9e84-054ef6f109eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:36.136815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.137479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.137763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.138036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.138799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.139103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.140454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.148741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 279/566] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.149355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.191171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 288/567] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:36.193421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.193714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.193994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.211057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:36.212332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:36.243793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d582f8-cb5e-4a5e-8e80-8964b2934ef4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.275012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 289/568] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:36.275543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.275816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.276337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.276613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.276883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.283381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.284832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:36.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:36.300802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:36.302254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 280/569] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:36.303273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.371379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154df30-8107-4fe7-b7ca-2ec6c681540c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.393806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09383d71-4299-4a6d-8372-98611bf4016e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.402872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.403664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.403942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.404213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.414274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.415755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.426702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.427489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.427770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.428044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:36.432516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:36.433495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:36.434381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:36.434381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:36.434381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:36.434381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:36.434381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 290/570] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:36.434699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.442357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.443870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:36.461503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:36.462551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 281/571] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:36.463501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.531488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28781f6-d8ce-4053-abaa-10c31b118e58 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.555565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a458a76-4cee-4ddf-9635-74acc59ed046 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.564442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.565231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.565511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.565784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.576046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:36.583889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:36.584901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:36.585757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 291/572] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:36.586473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.589709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.590482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.590790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.591067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.601705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:36.609398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:36.610351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:36.611255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 282/573] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:36.612170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.686143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3ce35-8296-4da5-b5ba-4e4942335b4f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.705007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edc0769-a2b0-4d47-aea7-52e15695aa65 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.717201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.717854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.718133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.718405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.719207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.719508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.720912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.732667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 292/574] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.733453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.736727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.737552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.737992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.738269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.739573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.739881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.741249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.752668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 283/575] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.753298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.824767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d514d6ca-e96b-40ec-bd75-d7ddf5b2d575 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.844685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e2f55-976e-4974-8bb6-8ab1b2c9f94f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.856084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.856736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.857013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.857283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.857980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.858277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.859651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.870734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 293/576] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.871503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.881907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:36.882592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:36.882883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:36.883159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:36.883891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:36.884195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:36.885548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:36.893119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 284/577] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:36.893883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:36.968263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c580599-20ea-435f-8571-ba4d8373e60b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:36.992105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa3121-7b72-471b-8518-b4309ea36759 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.002763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.003729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.004153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.005083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.006163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.006650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.008222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.017645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 294/578] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.018492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.026622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.027287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.027573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.027850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.028673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8ecb9355635e486aa8e5f9e4d38ead62) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.028985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.030408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.035878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 285/579] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:36 2022] GET /identity/v3/role_assignments?user.id=8ecb9355635e486aa8e5f9e4d38ead62&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.036524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.122066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283071-b0b7-4854-aef6-c93c1e1c7f2b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.140445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab113693-2548-4b89-90c9-c326ddd63481 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.157843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.158687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.158969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.159241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.166476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.167954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.178174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.179299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.179723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.180137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:37.183480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:37.184406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:37.185323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:37.189317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.189991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 295/580] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:37.190913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.191014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:37.205986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:37.207087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 286/581] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:37.208580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.296033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd488c4e-a15d-4946-8a8a-f2b00e01d8ee None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.307147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d40a9-b825-400e-a042-24bf14317942 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.334442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.335491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.335923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.336355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.340477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.341273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.341557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.341831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.346854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.348910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.352613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.354052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:37.366794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:37.367716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 296/582] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:37.373507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:37.373861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:37.374686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 287/583] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:37.376139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.472760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b820cea-d619-4520-abeb-149028f9cfa0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849682c-1c48-4dca-b4c2-3a46971b5b92 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.506287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.506494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.507005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.507130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.507304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.507412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.507560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.507652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.508362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.508458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.508667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.508764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.510079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.510174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.521811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 297/584] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.522723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.533969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 288/585] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.533969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.624932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89ba48f-8e12-4c8a-a57d-5575bf8cb273 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.630397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a14d1e-4ff8-450b-a252-bfd59bd6ba71 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.663322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.663987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.664271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.664540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.665255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.665559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.665654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.666295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.666704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.666964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.668952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.669680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:37.669987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.671349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.685309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 289/586] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.685309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.691080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 298/587] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:37.692225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.784234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931e45d-5bdb-43c1-a460-d49acd1f0d18 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.787752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc4bfb-e260-4ac2-bc2c-7de8094ebae0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.818431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.819368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.819654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.819928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8730a384ede5490eaa8e818e7c60518d/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.824320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:37.825118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:37.825399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:37.825668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:37.835237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=8730a384ede5490eaa8e818e7c60518d, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.835674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:37.836688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.837108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:37.859403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 290/588] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:37 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8730a384ede5490eaa8e818e7c60518d/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:37.859403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:37.859692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:37.860499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 299/589] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:37.861395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:37.982226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8eb7b-b8ae-412d-ba88-5de376f7b10b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:37.982766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab78917-6970-442d-ada4-5f4f6a1cf3ab None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.020514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.021386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.021667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.021943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.022436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.023351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.023693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.024031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.030502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.032068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.032188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.033700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:38.049111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.051885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:38.054263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:38.055551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.057548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:38.062084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:38.063694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 291/590] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.063694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.063980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 300/591] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.063980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.169984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4c04-88b1-49c7-9a50-75f0f7bb22f0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.174390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805a254-e98f-40b1-bee2-63f56e14e2b3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.208574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.209258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.209536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.209807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.211273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.211273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.212958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.219484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.220277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.220456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.220704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.221421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.221913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.223707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.235654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 292/592] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.236503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.237207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 301/593] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.241450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.343020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f56912-feb4-436c-9ac7-268fbc28b9e2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.359651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b05e23-1d68-4ef0-98d5-cbdf68e79aa9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.387980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.389485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.390025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.390471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.391476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.392056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.393375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.393879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.394374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.394778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.395206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.402415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.404009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.414378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 293/594] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.415525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:38.423170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.424264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:38.425451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:38.431533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 302/595] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.432471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.537877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb040-03e6-4205-ae1b-a4fe3754372d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.544000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c54f60-f007-4adc-95cf-1df0a3ee35c9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.571944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.573010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.573438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.573854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.579121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.580025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.580418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.580788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.587386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.589054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.591724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.593255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:38.609533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.610710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.611818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:38.611818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:38.611818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:38.611818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:38.612861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.614259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.615277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:38.615277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:38.615277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:38.615277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:38.616506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 303/596] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.617457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.619594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 294/597] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.620511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.719064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779ec3b-ed73-4c8b-b80c-e00a3157810c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.749308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e2c63-91f2-43a9-9a19-b9fd095b4404 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.753361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.754102 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.754503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.754874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.755850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.756220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.757651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.774055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 295/598] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.775072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.788094 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.788703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.789051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.789390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.790280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.790640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.792115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.808792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 304/599] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.810019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.883075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac13cf-7710-4a44-8b76-93eadde35207 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.911863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e521ca4c-e340-405d-b03e-e26667bede5e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:38.917079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.917743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.918020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.918338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.919141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:38.919452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.920820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.933325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 296/600] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:38.934241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:38.950039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:38.951219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:38.951725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:38.952205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:38.961837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:38.964026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:38.982046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:38.983033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:38.983976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:38.986650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 305/601] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:38.987654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.046623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183396ae-3ae3-45ec-b41b-c720ac156f6e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.081642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.083243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.083653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.083909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.104520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=1bc19fa7285245d8bdb984da94d502b8, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.106628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.112278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14048af-3ef1-4a4e-81ec-68cf24ce063d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.127227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 297/602] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:38 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:39.129190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.152585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.153807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.154160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.154513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.164183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.166417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:39.185530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:39.186620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:39.187532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 306/603] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:39.193585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.292720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9355e-4cb1-424a-9613-71ef4266638f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.334701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.335735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.336239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.336712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.337721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:39.338245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.339934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282a97e-c48b-4cb4-bee0-1c7135752632 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.352434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 298/604] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:39.354055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ab91-a10c-440a-8bde-bafb9f5eec75 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.354501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ab91-a10c-440a-8bde-bafb9f5eec75 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.354941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23ab91-a10c-440a-8bde-bafb9f5eec75 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.357246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 299/605] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:39.358149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ab91-a10c-440a-8bde-bafb9f5eec75 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.401592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fbe29d-5f03-4498-88a1-afce115e0383 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.441502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.443281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.443571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.443849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.444636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:39.444944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.447177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caa93b6-fd1b-460d-b2d4-09223d5b542b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.464420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 307/606] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:39.465990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.466278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.466555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.482860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23ab91-a10c-440a-8bde-bafb9f5eec75 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.486618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:39.487818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:39.529538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.530951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.531438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.531913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/0292f8e2e5ff4fe8939c078d01993ea1/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.550471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=0292f8e2e5ff4fe8939c078d01993ea1, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.553122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.570545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 300/608] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:39 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/0292f8e2e5ff4fe8939c078d01993ea1/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:39.571926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.578671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 308/608] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:39.595793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:39.693009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30212ce-0221-4aea-81fa-2e5c6eadf409 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.732039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.733079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.733458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.733828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/d4fbd6d1978f41e1af28e18d26395767/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.749872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=d4fbd6d1978f41e1af28e18d26395767, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:39.751536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:39.768842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 301/609] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:39 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/d4fbd6d1978f41e1af28e18d26395767/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:39.785516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d73f3b-9d49-42d2-bafa-eb1068b1dcd7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:39.828270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:39.829385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:39.829821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:39.830245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:39.844288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:39.853369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:39.854628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:39.855697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:39.858359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 309/610] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:39.866640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.002733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350daed-3532-494f-b14b-74ca832cecaf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.043859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.044541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.044827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.045224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.045974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:40.046286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:40.047707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:40.056954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 302/611] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:40.062207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.172975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df3981-b917-4e84-8465-644337ddd270 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.211855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.212674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.212961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.213240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.224459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:40.226091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-089647b2-9072-42bc-b45d-daa230e579da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:40.251866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:40.252812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:40.254147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:40.254147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:40.254147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:40.254147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:40.254147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 310/612] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:40.258710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.293699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7a3b-39d4-4a81-811f-e92cca6c1e2f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.294015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7a3b-39d4-4a81-811f-e92cca6c1e2f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.294260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e7a3b-39d4-4a81-811f-e92cca6c1e2f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.295927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 311/613] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:40.302119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.302483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.302861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.320095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:40.321390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:40.396737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12c581b-7b45-44d9-bd17-5010b21594a7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.431786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.432814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.433302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.433780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.434890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:40.435407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:40.437156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:40.452371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 303/614] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:40.457228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.464220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 312/615] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:40.487663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.578842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ad37a-0e6a-49ed-bdcb-ec45f3c61463 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.626528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.627369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.627649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.627922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.639436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:40.640890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:40.663679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:40.664784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:40.666437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 304/616] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:40.675614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.698929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b89646a-5ba2-4d28-bb48-4d9084e3b459 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.761178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.761975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.762252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.762523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.780179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:40.791248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:40.792235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:40.793113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:40.797655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 313/617] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:40.803618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.851737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab77a40-887d-4d93-a9ee-2017f9a2f7e8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:40.921931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:40.922686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:40.922965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:40.923234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:40.924146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:40.924405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:40.925840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:40.945033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 305/618] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:40.950330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:40.954256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f325f8-be2d-4dfc-a59e-a5fa784e5931 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.009974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.011585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.012302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.013001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.014585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:41.015121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.016733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.034256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 314/619] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:41.039885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.054601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d011dc73-4724-4fe8-ab98-07e42f92e5ae None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.088123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.088957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.089882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.090007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.110731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.110731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:41.123887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:41.124845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:41.131004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:41.131004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:41.131004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:41.131004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:41.131004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 306/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:41.131980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.231623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8e5ea-e8a5-4f1d-822d-87d1cf28c20c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.265995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.267118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.267401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.267825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.268608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:41.268913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.270500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.283201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 307/621] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:41.289470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.304700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea943013-fcbf-4c35-b503-b175bb9925ec None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.396249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8969138-49c9-4ee2-b44a-7736dd888743 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.400827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.401668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.401953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.402230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.428655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.430125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.444371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.445179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.445511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.445782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.459762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.461212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:41.472557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:41.475208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:41.477541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:41.477541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:41.477541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:41.477541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:41.477541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 315/622] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 434 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:41.486749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:41.488000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:41.489534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:41.490473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:41.495589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 308/623] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:41.500014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.592217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550dad9-4d1b-40eb-b492-ecca94935508 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.629105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.631075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.631366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.631636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.632382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:41.632684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.634088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.649581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 316/624] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:41.659682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.696427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b01f6b-919f-4b91-9801-8f1483bc0b2e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.745745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.746833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.747353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.747843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.748864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:41.749379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.751090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.774960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 309/625] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:41.780500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.794899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d941bd-ad78-45a6-b937-65e155b2d535 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.848554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.849375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.849643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.849916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] PATH_INFO: `/v3/users/glance` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.857315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.858782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-976044d6-e041-42be-a0d5-81487ad72572 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:41.873339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:41.874338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 17 17:59:41.875363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:41.879154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 317/626] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:41.881058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5575-d836-4037-a207-f0a203bbed65 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.881344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5575-d836-4037-a207-f0a203bbed65 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.881616 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e5575-d836-4037-a207-f0a203bbed65 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.883174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 318/627] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:41.883872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e5575-d836-4037-a207-f0a203bbed65 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:41.909764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf921f-acba-4f8e-9d73-beb5c72d5b41 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:41.950175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:41.951163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:41.951569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:41.951896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8ecb9355635e486aa8e5f9e4d38ead62/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:41.976124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=8ecb9355635e486aa8e5f9e4d38ead62, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:41.977952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138dc89-d185-4984-8b2b-0dbe082c62a2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.002820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 310/628] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:41 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8ecb9355635e486aa8e5f9e4d38ead62/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:42.003798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e5575-d836-4037-a207-f0a203bbed65 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.005038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.005556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.006012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.036281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:42.038007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:42.056224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.056926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.057206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.057480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.058330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:42.058664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.060584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.102001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 319/629] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:42.108490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.197724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 311/630] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:42.246830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8499df-083d-45a8-a331-e4d4c358acb2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.260048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.294467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.295147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.295423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.295689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.382021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.383498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4fef-ee1b-4d91-a320-0f1e37f184ab None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.390845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b58af49-4ac7-4558-b729-da3b72a14755 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.423994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.425300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.425300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.425505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.436285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-11b047ab-b272-4098-8e9e-15506123bd89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:42.444887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:42.446293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:42.447192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 312/631] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:42.452148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d6e4-3427-405a-a968-04b617db5b06 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.452433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d6e4-3427-405a-a968-04b617db5b06 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.452706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a910d6e4-3427-405a-a968-04b617db5b06 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.454743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 313/632] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:42.456299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910d6e4-3427-405a-a968-04b617db5b06 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.515659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 320/633] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:42.518277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.518759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.519181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.537150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:42.538547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:42.562359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a910d6e4-3427-405a-a968-04b617db5b06 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.596953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.597819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.598664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.598977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.599739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:42.600039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.601464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.609348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 321/634] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:42.610588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.615309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 314/635] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:42.616257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.711357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9882443-f796-42e6-be0f-8954f6350277 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.716946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec4a31-114d-45a8-991c-4705e77f1186 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.743873 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.744684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.745104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.745384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.750092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.750913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.751195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.751466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.756432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.757858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.762619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.764063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:42.779501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:42.780411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:42.781363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:42.781363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:42.781363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:42.781363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:42.781363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 322/636] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:42.782231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2accaf22-1e34-41ab-8ba1-e3df9767d8b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:42.783470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:42.784347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:42.785246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:42.785246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:42.785246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:42.785246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:42.787321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 315/637] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:42.788756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f796b0-79de-474b-98e0-7288f321520f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.789041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f796b0-79de-474b-98e0-7288f321520f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.789315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f796b0-79de-474b-98e0-7288f321520f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.790725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 316/638] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:42.791257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f796b0-79de-474b-98e0-7288f321520f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.889632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa4254-f19e-4481-bed3-4e2b8e6285a4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.892655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f796b0-79de-474b-98e0-7288f321520f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:42.926202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.927043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.927273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:42.927389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.927567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.927939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.928224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.928503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.929226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:42.929541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:42.930935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:42.938075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:42.943376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 317/639] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:42.944183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-242888d3-e9a1-4c56-bf5a-23555906c922 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:42.947465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:42.948414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:42.949297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:42.949949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 323/640] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:42.950802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:42.951090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:42.951367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:42.969388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:42.970599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:43.039831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 324/641] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:43.040973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.064596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2ce0e-9d4a-47ec-b3c1-d36a01ea95f7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.101493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.102160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.102443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.102746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.103456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.103762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.105129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.121294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 318/642] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.121294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.141349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab768888-4d84-4aba-a2c9-3c79bfecf124 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.173106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.173891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.174176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.174443 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.181477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.182926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:43.197177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:43.198276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 325/643] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:43.199275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.223662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c83e8-d99d-4e86-b8e0-691d60fe5f5d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.259179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.259852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.260133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.260409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.261145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.261465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.262848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.270705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 319/644] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.271501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.299734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f621500-dc70-4558-a1de-53cb1f91921e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.334010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.335178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.335672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.336171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.346738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:43.355680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:43.356888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:43.358012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:43.361909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 326/645] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:43.362914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.371245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0f070-1372-44ec-a411-7c89e04fe86a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.406430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.407265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.407576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.407830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.417819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.419337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:43.433873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:43.434941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 320/646] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:43.435953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.470595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e460f53-d232-4f29-b1c1-b57def07685c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.505636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.506452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.506878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.507222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.508072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.508447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.509941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.527134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 327/647] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.527134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.536675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc00efd8-23ed-45e1-bb47-ff7497d600f5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.569604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.570469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.570883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.571251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.582396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.583989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:43.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:43.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:43.603607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:43.603607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:43.603607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:43.603607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:43.603607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 321/648] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:43.603891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.644457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8607f15-e69a-4365-a156-9cd93b7c7953 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.681506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.682608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.682900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.683398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.684888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.685690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.688014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.704563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 328/649] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.704563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.706807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c601b3d-98dd-444c-8788-4b653142de26 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.740969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.741779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.742172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.742543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.743517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.743830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.745262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.762814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 322/650] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.763641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.811806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e83f77-b435-4e9a-b15c-22fc5bf02cfb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.844423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.844994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.845271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.845538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.846345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8730a384ede5490eaa8e818e7c60518d) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.846677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.848073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.860660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 329/651] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/role_assignments?user.id=8730a384ede5490eaa8e818e7c60518d&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.860660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.888728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96ad19-af3c-4f7c-a057-a772ce4eb054 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:43.930661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:43.931501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:43.931918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:43.932300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:43.933253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:43.933663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:43.935216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:43.957779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 323/652] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:43.959289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:43.990053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848bb377-a3fe-43db-94de-656563f1b6d7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.028937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.029754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.030285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.030558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.042766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.044248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:44.064365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:44.065360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:44.066266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:44.066266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:44.066266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:44.066266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:44.066266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 330/653] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:44.066556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.101750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7950c3a-1bfa-4fd4-ac82-6f3e132560b4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.147029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.148665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.148665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.148665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.184977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f1413-77d3-4fad-8e61-0756f85596fb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.222812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.224168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.224459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.224734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.228033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.230108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.232738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.234747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:44.250070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:44.251490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 17:59:44.252450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:44.257471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 331/654] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:44.259080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.352971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 324/655] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:44.354253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.412440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4349e-ed86-454b-a04a-94547b5b9c33 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.468068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a87d6-01b0-4963-8b4b-08157c7c6aca None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.477145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.478785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.479081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.479359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.480094 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:44.480700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.481776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.501240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 332/656] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:44.502274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.511490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.512528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.513004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.513489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.514520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:44.515052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.516711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.541572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 325/657] 10.222.0.25 () {56 vars in 1137 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:44.543419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.612477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e78ff5-4174-457a-b8a6-cffa99764dbc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.649915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.650776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.651053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.651326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.663121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.665100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:44.694909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:44.695883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:44.696794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:44.696794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:44.696794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:44.696794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:44.697126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 333/658] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:44.697709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.720258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb1be46-ca70-42e3-bf9d-55b028ab51ff None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.764794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.765669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.765954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.774607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.776692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.778141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-3831df51-3fd1-493e-beec-54ae869be951 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:44.797576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:44.798660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 17 17:59:44.799638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:44.803576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 326/659] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:44.804830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea3e1-ec1f-468d-89fe-a1d7d5104082 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.805114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea3e1-ec1f-468d-89fe-a1d7d5104082 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.805387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea3e1-ec1f-468d-89fe-a1d7d5104082 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.806861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 327/660] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:44.807404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea3e1-ec1f-468d-89fe-a1d7d5104082 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:44.819305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08f4fb-0895-408f-a217-d33214e169bd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.857543 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.858377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.858499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.858783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.908641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea3e1-ec1f-468d-89fe-a1d7d5104082 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:44.941042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.943628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650105e-4fbe-4eff-9066-0f4fbb91ccc5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.959198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:44.959972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:44.960145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:44.960444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:44.961164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:44.961446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:44.966121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:44.980917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 328/661] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:44.981596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.068910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 334/662] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:45.069441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.069739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.070019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.080059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7ce48a-4f47-4de8-8911-aad9a094433a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.087439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:45.088628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:45.113546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.114549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.114708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.114969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.115854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:45.116099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.117558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.135825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 329/663] 10.222.0.25 () {56 vars in 1139 bytes} [Tue May 17 17:59:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:45.136635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.155554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 335/664] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:45.156588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.247520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efa87e-923d-4fe0-90de-0a2b652f6ee1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.265294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8189bf-6b4e-4b80-862a-a2366f850325 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.284192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.285049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.285325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.285739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.292500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.293948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.298227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.299064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.299355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.299667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:45.308177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:45.309095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:45.310012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:45.310967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.312401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.314318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 330/665] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:45.314925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:45.333369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:45.334362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 336/666] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:45.340258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.412357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d47a6f-a37c-482d-9f98-191ce2fe9276 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.432120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2a6d5-023f-467d-9aad-c2f0edbfd1a7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.448575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.449226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.449509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.449967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.466907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.467949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.468224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.468496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.479125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:45.486843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:45.487786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:45.488736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 337/667] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:45.489786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.520285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.521676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.584030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163434-1719-4717-90f6-10a4f9d3d86d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.617386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.618197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.618387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.618695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.623310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 331/668] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:45.623725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:45.623725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.623918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.624008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.634977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 338/669] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:45.635684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.726004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce45e9b-4368-4339-8120-ddddc4fe1039 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.744285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1120294d-7d17-4da4-b0ac-5a9ab1484000 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.759489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.760155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.760439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.760717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.761428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:45.761732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.763142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.778340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 332/670] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:45.778340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.781481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.782216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.782498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.782797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.783533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:45.783831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.785206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.793970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 339/671] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:45.794807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.887736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895092b7-bb7d-43d7-bba0-cfbabc939d7a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.902894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8a4fb-b322-4600-a5e8-741626539727 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:45.925578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.926971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.927252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.927525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.938867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.940414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.942180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:45.943048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:45.943470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:45.943881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:45.944856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:45.945303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:45.946887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:45.952658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 340/672] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:45.953607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:45.957172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:45.958680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:45.959728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:45.959728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:45.959728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:45.959728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:45.959728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 333/673] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:45.960189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.075761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a01d6e-8b3d-4114-a7d5-3e6c0b3136d5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.096973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a3ad4-5d36-4846-a093-6c5406e65b89 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.114775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.115910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.116374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.116849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.129333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.131282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.138448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.139854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.139854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.139854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.148395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.149843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:46.153257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:46.154202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:46.155169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:46.155169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:46.155169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:46.155169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:46.162103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 334/674] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:46.163391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:46.166389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:46.167359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:46.168265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 341/675] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:46.168766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.278153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02b07f-0253-49ad-9af3-0be896b2027f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.281010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ad904-fad7-4b43-9615-cd080f5e5ed5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.313888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.314893 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.315295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.315701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.316556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:46.317178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.318065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.318950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.319122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.319578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.320014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.320898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:46.321370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.322935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c241f1-d0ea-481a-aefa-f7bbd38f8bdb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.335226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 335/676] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:46.335226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.335458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 342/677] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:46.336729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79372-ec4f-42db-98c9-5a8e2d25b359 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.337018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79372-ec4f-42db-98c9-5a8e2d25b359 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.337291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b79372-ec4f-42db-98c9-5a8e2d25b359 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.338675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 343/678] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:46.343257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79372-ec4f-42db-98c9-5a8e2d25b359 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.437550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9df0bf-71e9-4d85-a000-e4c5c7717b6a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.444892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b79372-ec4f-42db-98c9-5a8e2d25b359 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.472354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.473368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.473819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.474251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.475070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:46.475381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.476818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488cc13-82b9-4c5f-9f73-530046731617 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.478507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.479489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.479599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.479880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.487466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.493992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 336/679] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:46.494130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.494210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.494210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.494210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:46.509027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:46.510041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:46.515866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:46.516468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:46.516555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 344/680] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:46.516627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:46.516699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.578648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 337/681] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:46.578648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.620581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf5bfa-be1a-4750-a4e6-eb67d090e3bb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.655034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.655830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.656114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.656382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.663639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.665061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:46.679730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:46.680648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:46.681585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 345/682] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:46.682097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.694365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ee94e-c4c0-4b35-a4be-baaf317ed202 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.732194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.733197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.733706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.734178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.735206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=0292f8e2e5ff4fe8939c078d01993ea1) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:46.735666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.737254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.743790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 338/683] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/role_assignments?user.id=0292f8e2e5ff4fe8939c078d01993ea1&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:46.744650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.795522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4025ca-c419-4e60-86b8-df76531d1b41 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.842638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.843858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.844644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.845111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.846149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:46.846675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.849482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.861039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5daa7-9a39-4dad-9249-16fbd54375ef None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:46.874778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 346/684] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:46.876181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:46.898624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:46.899690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:46.899963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:46.900346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:46.913723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:46.915390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:46.938756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:46.939788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:46.940743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:46.940743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:46.940743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:46.940743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:46.940743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 339/685] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:46.941611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.009507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a9de9-6998-4b20-9df5-682287f6995e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.060586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.061600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.061948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.062307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.063453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:47.063831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.064183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd463285-5ae1-4aa0-81a3-2e4c5001abd2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.065392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.080645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 347/686] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:47.081712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.099686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b359a-631c-494d-9718-730d2d39830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.100640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b359a-631c-494d-9718-730d2d39830d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.101100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b359a-631c-494d-9718-730d2d39830d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.101568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b359a-631c-494d-9718-730d2d39830d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.170314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b359a-631c-494d-9718-730d2d39830d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.172067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b359a-631c-494d-9718-730d2d39830d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.205375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2825-217f-4ea8-8a00-73065326abe6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.250652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.251862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.252213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.252575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.253367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:47.253736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.256462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.272864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 348/687] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:47.273930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.279017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 340/688] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:47.280056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b359a-631c-494d-9718-730d2d39830d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.389174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecbd8d-5e43-4d01-8a74-8ffabaed2c8c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.405107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b359a-631c-494d-9718-730d2d39830d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.423674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.424253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.424517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.424850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.425672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=d4fbd6d1978f41e1af28e18d26395767) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:47.426004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.427747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.438941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 349/689] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:47 2022] GET /identity/v3/role_assignments?user.id=d4fbd6d1978f41e1af28e18d26395767&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:47.439854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.448197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.449280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.449774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.450257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.451259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.452923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.487394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 341/690] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 17:59:47 2022] POST /identity/v3/users => generated 254 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:47.606940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4de75-73d5-480d-a484-8f460cbe2a82 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.646420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.647270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.647548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.647821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.660599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.662234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:47.681466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:47.682423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:47.683821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:47.683821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:47.683821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:47.683821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:47.683821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 350/691] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:47.689021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:47.808823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4906d8ec-494c-4221-bdd9-20146b4caaa7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:47.843619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:47.844312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:47.844596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:47.844872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:47.845635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:47.845943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:47.847409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:47.861650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 342/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:47.869627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:48.009455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dd24-e67e-4b31-883f-2e1fee8974c7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:48.060413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:48.061273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.061557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.061824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.069469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:48.070942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:48.085406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:48.086393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:48.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 351/693] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:48.094149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:48.257529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f0bb4-8256-4562-b54d-b7641b5ae86b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:48.314686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:48.314686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.314686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.314686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.318594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:48.318594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:48.320547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c62642a-ddd9-4ef9-91f6-b1801a6e215f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:48.334607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 343/694] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:48.337912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:48.447187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c44176-79aa-4918-9ab5-64fd1c196f32 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:48.481743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:48.482399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.482709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.482984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.483803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8ecb9355635e486aa8e5f9e4d38ead62) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:48.484109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:48.485531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd55d2a-5706-4887-b2e4-9105c39efeff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:48.492527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 352/695] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:48 2022] GET /identity/v3/role_assignments?user.id=8ecb9355635e486aa8e5f9e4d38ead62&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:48.522224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8170c7-3965-4a0c-9a8e-a10255428c3e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.522552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8170c7-3965-4a0c-9a8e-a10255428c3e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.522861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8170c7-3965-4a0c-9a8e-a10255428c3e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.524233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 344/696] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:48.539676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.539995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.540224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.562433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:48.563956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:48.638531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 353/697] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:48.675504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8170c7-3965-4a0c-9a8e-a10255428c3e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:48.811734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8170c7-3965-4a0c-9a8e-a10255428c3e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:48.848464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:48.849700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:48.850206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:48.850734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:48.864936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:48.872989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:48.873923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:48.874841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:48.877569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 345/698] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:48.883024 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:48.996139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8042bc54-f832-46c8-9f71-ae0488598625 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.034825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.036244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.036610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.036887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.037646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:49.037948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.039337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.048494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 354/699] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:49.055676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.167349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0231aa3-5825-4ad5-8d7f-8e4c3b5004bc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.204218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.205072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.205356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.205630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.217194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.218678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7c7659d4-8a11-4481-a52a-c8f8a7139bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:49.236140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:49.237187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:49.238091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:49.238091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:49.238091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:49.238091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:49.238091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 346/700] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:49.243840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.357477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f2ee-90db-48fe-b005-e7b3e72c3cd1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.357770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f2ee-90db-48fe-b005-e7b3e72c3cd1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.358254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f2ee-90db-48fe-b005-e7b3e72c3cd1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.361063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 347/701] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:49.364939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.365238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.365626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.384600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6208122a-0173-442c-8604-5732041c1b22 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.396148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:49.397444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:49.418968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.419922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.420397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.420833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.421710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:49.422177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.423735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.436028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 355/702] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:49.444489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.566178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7b213-c498-4cf4-93b2-5d04b01aa8e2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.568130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 348/703] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:49.601663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176d850-f753-4398-9113-77335a046d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.602473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d850-f753-4398-9113-77335a046d3f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.602779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d850-f753-4398-9113-77335a046d3f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.603054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176d850-f753-4398-9113-77335a046d3f None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.605805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.622303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d850-f753-4398-9113-77335a046d3f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.624379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176d850-f753-4398-9113-77335a046d3f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4176d850-f753-4398-9113-77335a046d3f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:49.640614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:49.641638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:49.642652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:49.645361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 356/704] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:49.651215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176d850-f753-4398-9113-77335a046d3f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.761998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae954f5a-0fcb-4330-aac9-8de240869170 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.800204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.801559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.801844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.802113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.802792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.805570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.808085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176d850-f753-4398-9113-77335a046d3f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:49.826064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:49.827466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:49.828347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 349/705] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:49.833152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.892154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.892851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.893109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.893381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.894216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:49.895133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.896840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.933079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2dca2-4604-450d-967c-beef52e782f8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:49.933387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 357/706] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:49.939875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:49.975858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:49.976557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:49.976835 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:49.977106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:49.977819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:49.978150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:49.979613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:49.984608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 350/707] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:49.990564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.101591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ab97a-7602-4703-8be1-3256c43fffc9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.161388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8fcf66-6cee-49f5-a34d-6f6534254821 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.175359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.176113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.176394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.176663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.177371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:50.177671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:50.179077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef2863-3fe6-42f4-b55a-ff30e7815a23 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:50.189480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 351/708] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:50.218083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.219178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.219689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.220189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.322647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:50.324540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:50.350944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5a49-102d-4f25-9290-3514ce0fa9d5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.351258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5a49-102d-4f25-9290-3514ce0fa9d5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.351500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e5a49-102d-4f25-9290-3514ce0fa9d5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.353042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 352/709] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:50.358658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b18a2-ef54-4d91-87ef-a3f26f1ad95e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.358946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b18a2-ef54-4d91-87ef-a3f26f1ad95e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.359233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b18a2-ef54-4d91-87ef-a3f26f1ad95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.387630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8d2b18a2-ef54-4d91-87ef-a3f26f1ad95e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:50.389947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8d2b18a2-ef54-4d91-87ef-a3f26f1ad95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:50.481811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 358/710] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 17 17:59:50.487277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.499741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 353/711] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:50.501255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e448d2-d5ed-4acc-b138-c59970a2da3b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.501544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e448d2-d5ed-4acc-b138-c59970a2da3b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.501824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e448d2-d5ed-4acc-b138-c59970a2da3b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.504614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 354/712] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:50.510117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.510406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.510716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.528606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:50.529781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:50.592992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d58c08e-c963-4573-967c-ee88b5d6d159 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.597852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 355/713] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:50.606844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.629585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.631690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.633000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.633646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.651884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:50.654315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:50.676332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:50.677364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:50.678292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:50.678292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:50.678292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:50.678292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:50.682638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 359/714] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:50.684402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.739749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6f61c9-17d4-40d0-a62f-e16c2b73cd35 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.783003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.783812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.784087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.784354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] PATH_INFO: `/v3/services/network` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.785021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:50.786671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:50.796188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398a481e-73d7-4a85-83f2-cae7cf5ee398 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:50.798230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:50.799408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:50.800293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 356/715] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:50.802183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.843626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.845046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.845623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.846240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.860637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:50.871245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:50.872240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:50.873130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:50.881066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 360/716] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:50.881066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.908935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac549f6-5a18-42a3-8679-f6298c3bd0f3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:50.954054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:50.955074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:50.955618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:50.956073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:50.957560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:50.958148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:50.960103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:50.981257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 357/717] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:50.981257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:50.987160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafb205-c946-4252-a9ce-1f8c3996f3d2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.020673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.021351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.021628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.021896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.022614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.022932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.024295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.034186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 361/718] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:51.036292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.100291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200dde4d-7f25-406e-8f57-c25e2cfadc9d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.143374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6514e47-610a-4f91-9595-db6aae2492a8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.143658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.144512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.145499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.146300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.148038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.148500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.150052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.165641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 358/719] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:51.165641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.185583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.186807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.187296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.188442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.198811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.200710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:51.220176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:51.221140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:51.222071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:51.229407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 362/720] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:51.229407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.282763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99115ff5-9475-44cd-b0df-d218455adf15 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.318249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.319015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.319294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.319565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.320280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] RBAC: Adding query filter params (type=network) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.320559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.321921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.326741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 359/721] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/services?type=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:51.327623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.342208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca6a4-bd3a-4e08-8295-bf9f645dfc42 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.391168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.393161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.393832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.394334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.409260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.412526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:51.432593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:51.433597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:51.434514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:51.434514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:51.434514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:51.434514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:51.434514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 363/722] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:51.440237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.441388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb8cea-04bf-4e1b-a48a-3291e6eeea66 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.486771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.488910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.489667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.490135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.491339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.492203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.493858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.511360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 360/723] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:51.517569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.547644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374954a0-5fbe-4656-add9-70f2c9708bc4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.583548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.584382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.584671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.585012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.585793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.586161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.587653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552705e7-8aca-4a68-9d4f-cdd9f4e5f647 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.600515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 364/724] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:51.602054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65d3d-7290-4ae2-931d-db1e40821099 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.606669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65d3d-7290-4ae2-931d-db1e40821099 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.607190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c65d3d-7290-4ae2-931d-db1e40821099 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.609006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 365/725] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:51.609858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65d3d-7290-4ae2-931d-db1e40821099 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.629863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea3d72-3fed-418b-bd6f-69163d331b84 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.676981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.677958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.678423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.678951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.679964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:51.680456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.682092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d0074-c6fd-4496-b2ab-8a5dcf280add None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.688071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 361/726] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:51.689753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.690042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.690317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.731805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:51.734978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:51.740902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c65d3d-7290-4ae2-931d-db1e40821099 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:51.825522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:51.826378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:51.826706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:51.826968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:51.842739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:51.844227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:51.860928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 362/727] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:51.869872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:51.870946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:51.872558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 366/728] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:51.877154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:51.897797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.025441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8b45ef-47dc-4741-8dea-b98b3c101ae2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.061689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.062633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.063061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.064071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.065051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:52.065505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.067832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.087799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 363/729] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:52.093081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.096132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89b76ae-4960-41fd-8555-e5b2c23ccfa4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.156500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.157586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.158011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.158453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.169564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:52.178362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:52.179545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:52.180595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:52.183016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 367/730] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:52.189053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.286553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957bf91-ad84-4b7b-bb13-3e60cb620485 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.320276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59deb74-4a32-49ec-89b9-60f53656efc6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.360756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.361428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.361704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.361974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.362732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:52.363031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.364471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.366451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.367162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.367436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.367704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.384712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 368/731] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:52.389841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.497946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34afcbf-f3c3-4a30-994e-8ae81e82222d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.528958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.530394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.540729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.540729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.540729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.540729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.557460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.560419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:52.591638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:52.592593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:52.593562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:52.593562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:52.593562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:52.593562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:52.605934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 369/732] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:52.610939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.685727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 364/733] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:52.695552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.755077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33b403-b683-4619-b116-62ea3058b51b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.791139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.791828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.792166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.792711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.793425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:52.793724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.795098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.808673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 370/734] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:52.819645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.854522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2980bb-620c-405f-bb8e-c96b4e22aa6f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:52.888069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:52.889267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.889610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.889957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.900519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:52.902120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8409aa57-867f-4f55-bee8-4cc73d335932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:52.921134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:52.922320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 365/735] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a969c1e-b880-4004-a260-ccbc03d18876 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a969c1e-b880-4004-a260-ccbc03d18876 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:52.923301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a969c1e-b880-4004-a260-ccbc03d18876 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:52.929501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 366/736] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:52.929501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a969c1e-b880-4004-a260-ccbc03d18876 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:52.956019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c5b8d-b153-40dc-8887-b54c5f78139d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.005630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.006905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.007193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.007469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.019006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.021833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.033300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a969c1e-b880-4004-a260-ccbc03d18876 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.070334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.070965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.071300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.071577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.072360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:53.072669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.074076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbda47e-5b07-46b3-a55c-a376d491906a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.089064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 367/737] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:53.090481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.090797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.091074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.109431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:53.110720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:53.190593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 368/738] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 17 17:59:53.190593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:53.193296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:53.194553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:53.195825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:53.199569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 371/739] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:53.211088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.288645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2751a-6b3d-41e9-8854-2c42ab5c59fb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.314507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197f4a1-b8f4-4584-abb9-ea53ac32f14f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.323155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.323888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.324166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.324439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.331167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.332712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:53.346445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:53.347441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 369/740] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:53.349317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.354430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.355367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.355845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.356329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.357433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:53.357933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.359558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.377580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 372/741] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:53.378759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.474097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e87d78-7c16-4ed9-a39e-abac9993f091 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.483721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f704a4-5eb7-4283-8344-91603402c85a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.517665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.518331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.518647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.518929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.520237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:53.520550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.521047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.521931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.522036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.522496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.522982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.524078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.526013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.534524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 373/742] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:53.536013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.550822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 370/743] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 17:59:53 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 17:59:53.552149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:53.643980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76298eff-4949-4efe-9b33-42cd3ed91cf7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.690683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.690683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.690683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.690683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.745114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2866e-9b1c-430e-bd51-5a019d15266f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:53.821766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:53.822455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:53.823907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:53.824205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:53.825054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=ec0be08acb9049439ec2e7d22c616177) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:53.825370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.826854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.831800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:53.833302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c61229-fcc5-419a-a85a-6451a690a52a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:53.844225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 371/744] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/role_assignments?user.id=ec0be08acb9049439ec2e7d22c616177&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:53.950736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 374/745] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 17 17:59:53.957941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.026110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625edc8-0d17-482c-9b33-301cb9eb9e11 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.026457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625edc8-0d17-482c-9b33-301cb9eb9e11 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.026675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625edc8-0d17-482c-9b33-301cb9eb9e11 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.028337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 375/746] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 17:59:54.033734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.034791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.034791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.067887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:54.068418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:54.122637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c015b-040e-4809-9080-6bd340a36bf0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.169145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 376/747] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 17 17:59:54.186114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.186954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.187233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.187509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.193948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.219634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.221131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:54.247013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:54.247965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:54.249480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:54.249480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:54.249480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:54.249480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:54.249480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 372/748] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:54.256507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.339705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68b875-3517-4069-b134-91d105e2df07 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.365061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04338ad-e903-4a64-ada6-f69aaf9fbb14 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.374152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.374862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.375145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.375477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.376208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.377563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a852ab3-f0c6-4178-8268-3ca8a4eed76b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.394108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 377/749] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 17:59:54 2022] POST /identity/v3/services => generated 240 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 17:59:54.395631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26478f10-71dd-462f-a16e-cd6ea991a9e0 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.395928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26478f10-71dd-462f-a16e-cd6ea991a9e0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.396206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26478f10-71dd-462f-a16e-cd6ea991a9e0 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.402092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 378/750] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:54.403717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.404010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.404293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.422749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:54.424019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:54.440765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.441456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.441774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.442054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.442863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:54.443176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.444573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.461487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 373/751] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:54.468007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.545054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 379/752] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:59:54.583836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.642856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4a396-121f-40e2-9d17-155c9a359266 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.683773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.685161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.685445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.685720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.693347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11a83e-3377-4012-98fe-5be2e70c4c88 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.695220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.697520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:54.715036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:54.717080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:54.718162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 374/753] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:54.723041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.736218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.737074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.737360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.737633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.749764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:54.761080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:54.763403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:54.764705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 380/754] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:54.771664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.873131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27ac38-a3fc-4012-9083-6491adfd06b6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.918154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d096a16-b056-4810-9302-4a9c1ab11913 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:54.943272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.944004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.944232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.944509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.945308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:54.945618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.947087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.959724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 375/755] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:54.960594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:54.961502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:54.961990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:54.962470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:54.963864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:54.964442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:54.965877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:54.969012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:54.986384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 381/756] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:54.992607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:55.070021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc33cfe-833d-4046-8334-20eb9f119598 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:55.105245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:55.106294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:55.106814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:55.107318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:55.108347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8ecb9355635e486aa8e5f9e4d38ead62) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:55.108858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:55.110486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:55.116871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 376/757] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/role_assignments?user.id=8ecb9355635e486aa8e5f9e4d38ead62&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:55.130864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93633444-06a8-44f4-ba7d-9a477671fc61 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:55.190711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:55.191664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:55.192155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:55.192594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:55.206163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:55.208439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:55.231905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:55.232878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:55.233797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:55.233797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:55.233797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:55.233797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:55.239097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 382/758] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:55.239731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:55.385848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a0ee5d-d736-406f-82e2-a083f8d1d745 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:55.425228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:55.426964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:55.427474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:55.427965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:55.428898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:55.429402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:55.431059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:55.565818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 377/759] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:55.570918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:55.720731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6974f-66fb-4d05-92c4-468c48f2b4ef None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:55.763959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:55.764767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:55.765052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:55.765329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:55.776599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:55.778039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:55.795626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:55.796657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:55.797677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 383/760] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 17:59:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:55.803445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:55.945778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74610eb-abe0-4d88-8fd6-02cf94fb5a99 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:55.982794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:55.983516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:55.983796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:55.984069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:55.984907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:55.985211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:55.990991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.017999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 378/761] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 17:59:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:56.027679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.148357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6591b028-262f-4c02-bc50-02d08d690820 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:56.200593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:56.201431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.201716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.201989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.218340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:56.219829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:56.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:56.243696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:56.244621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:56.244621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:56.244621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:56.244621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:56.244621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 384/762] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:56.249470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.373319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c83810-9504-45c1-8cbf-ff123b25fa55 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:56.410519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:56.411457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.411742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.412046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.412741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:56.413047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:56.414414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9854ba3-eba1-4453-a06f-272ec61c283c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.431012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 379/763] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:56.436119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.490032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff057e8-c58b-4989-a147-0dbb8ee2d59e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.490219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff057e8-c58b-4989-a147-0dbb8ee2d59e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.490505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff057e8-c58b-4989-a147-0dbb8ee2d59e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.492114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 380/764] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:56.497262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.497553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.497833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.533394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:56.535219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:56.607828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 381/765] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 17:59:56.612706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0880526-2e1c-4e53-bfc7-f7f7a305ba11 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:56.654996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.656854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:56.658057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.658564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.659069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.668030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:56.669760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:56.686961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:56.687958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:56.689182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:56.692206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 385/766] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:56.700761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.808562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da41fd-756f-4411-9711-9c5fcff8954c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:56.829135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a72e4-b3e9-4364-bc2f-9f4ba6a05368 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:56.846961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:56.848581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.849066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.849516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.850344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:56.851912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-68f76434-a9d9-4265-aed8-e840d769e50d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:56.864190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:56.865185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 17:59:56.866089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:56.869156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 382/767] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:56.870648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a84bc-9bde-4580-a4df-d15f02389dee None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.871136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a84bc-9bde-4580-a4df-d15f02389dee None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.871632 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a84bc-9bde-4580-a4df-d15f02389dee None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.873320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 383/768] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:56.878413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:56.878413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.878413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.878413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.879459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:56.879459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:56.879459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132e0ceb-b08d-461f-9c32-0846ce9884ca None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:56.880963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a84bc-9bde-4580-a4df-d15f02389dee None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:56.894629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 386/769] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:56.899996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:56.900284 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:56.900557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:56.924448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:56.926409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:57.007952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 387/770] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:59:57.008812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.011966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a84bc-9bde-4580-a4df-d15f02389dee None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.052813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.053874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.054312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.054934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.056235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:57.057002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.058673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.065746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 384/771] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 17:59:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.067129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.134148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ebe8d-eb59-4068-9984-b8af5742b96e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.169204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.170248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.170694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.171133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.173199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=1bc19fa7285245d8bdb984da94d502b8, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.174031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e1dc6-26a6-4dfa-9f30-f85486a879b0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.174911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.195219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 388/772] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:57 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:57.195219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.252226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.253055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.253332 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.253606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.265904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-4411e406-7281-44df-a26e-7c45bb3d162e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:57.274709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:57.275724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:57.276614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 385/773] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:57.277319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ccce3-54d9-469e-9592-757e9d9f4e00 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.278144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ccce3-54d9-469e-9592-757e9d9f4e00 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.278144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ccce3-54d9-469e-9592-757e9d9f4e00 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.279427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 386/774] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:57.284883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.285258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.285544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.303824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:57.305199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:57.321590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c9ffdd-6578-46e0-bbd4-7cb960b7deff None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.357351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.358038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.358321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.358631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.359405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:57.359724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.361103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.373213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 389/775] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.374215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.389051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 387/776] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:59:57.390202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.496125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240465e2-5e18-4dbe-9824-f9961be8ede4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.517590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215eadb-e934-448f-93f4-3290f17b04d1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.531520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.532353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.532736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.533108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.533932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:57.534312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.535903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.544348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 390/777] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.545355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.560932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.562286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.563015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.563748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.564926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] RBAC: Adding query filter params (interface=public, service_id=9f89085b021d47a996ab898ad2c708f2, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:57.565717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.567556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.578309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 388/778] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/endpoints?service_id=9f89085b021d47a996ab898ad2c708f2&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.579618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.652638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc63341-1533-48a9-97de-f97dda2e86bf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.687717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e0d17-4b87-4d92-a8c9-8a219e56654e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.688514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.689495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.689889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.690264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] PATH_INFO: `/v3/services/network` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.692396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.693179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:57.708030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:57.709249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 17:59:57.710104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:57.715044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 391/779] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/services/network => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:57.715940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.728441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.729603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.730091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.730603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.741563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.743314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:57.761473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:57.762441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:57.763400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:57.763400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:57.763400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:57.763400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:57.765684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 389/780] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:57.766702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.821110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c154f-fe89-4493-9cdd-7f6a5aa85aee None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.854280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.854892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.855168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.855435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.856098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.857450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.870820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 392/781] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/services => generated 772 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.870820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.875826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97184e7e-27bb-46ec-888b-a14a87fc1088 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:57.913545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:57.914227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.914513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.914826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.915540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] RBAC: Adding query filter params (name=network) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:57.915852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:57.917255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf8110f-23b0-43d7-83bb-64cbb22d2b7c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:57.926112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 390/782] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:57.926833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82ebd-9b29-4ea6-acf2-133e44166565 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:57.927053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82ebd-9b29-4ea6-acf2-133e44166565 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:57.927215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf82ebd-9b29-4ea6-acf2-133e44166565 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:57.928743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 391/783] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:57.935304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82ebd-9b29-4ea6-acf2-133e44166565 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:57.991980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7365080-1636-41b7-bf2e-b6acd342d12a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.028493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.029179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.029461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.029733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.030472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.030811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.032224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c86090-ca83-4b8c-9fe5-b962da9f37a5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.044886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 393/784] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.046229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.046517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.046821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.056795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf82ebd-9b29-4ea6-acf2-133e44166565 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.064573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:58.065771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:58.093653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.094326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.094710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.094988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.095688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] RBAC: Adding query filter params (type=network) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.095994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.097352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.108368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 392/785] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 17:59:57 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.109199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.143762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 394/786] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:59:58.145220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.247547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b86d881-febe-4f3f-9e5f-aa361259df62 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.273705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bf6ee5-496d-4f4d-a983-04df66187276 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.281326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.282206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.282492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.282792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.290600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.292122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:58.307595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:58.309629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 393/787] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:58.311245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.318592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.318592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.318592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.318592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.319264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] RBAC: Adding query filter params (interface=public, service_id=d75278886be5434ea0907bb3e938be9e, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.319264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.319264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.325406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 395/788] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/endpoints?service_id=d75278886be5434ea0907bb3e938be9e&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.326303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.430810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80475693-4bc3-4f19-b7db-c0d4654eff61 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.440284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a263b557-eb79-496f-8fbe-37e157fff44e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.474769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.475005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.475503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.475785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.476103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.476405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.476837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.476948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.477225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.477505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.478655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.493591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 17:59:58.499547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 396/789] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.500515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 17:59:58.502029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:58.503194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 17:59:58.504780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:58.507250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 394/790] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:58.508187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.618618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e15f7-d42b-44a8-a430-3cd903adf0a9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.620241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d53e73b-60c8-4b00-b6e4-58eb5ba98d66 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.654900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.655854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.656281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.656727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.657545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.659070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.659287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.660636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.661176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.661455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.665681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 397/791] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.666676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.686631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.690990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:58.723944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:58.725114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:58.726112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:58.726112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:58.726112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:58.726112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:58.730222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 395/792] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:58.734460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.860532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3391bb-2c71-4708-888f-829535b098fb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.918230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b2c4f-3ca3-4a16-ac9a-e35398cf9cc0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:58.918588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.921998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.921998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.921998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.921998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.921998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.922338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.931732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 398/793] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.938678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:58.967435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:58.968115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:58.968389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:58.968658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:58.969376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:58.969678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:58.971073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:58.985779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 396/794] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:58.991482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.127622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a0e906-72b5-4b1d-a18c-abd16cfb5e85 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.152826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ffd71-bfd7-4185-b6fc-e44473b2c396 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.195824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.196560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.196840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.197113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.206620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.207998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.208352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.208626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.212279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.213749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.229563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.231048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 17:59:59.241010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:59.241944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 17:59:59.242891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 17:59:59.250749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 397/795] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 17:59:59.260204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 17:59:59.265520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:59.266449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:59.267390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 17:59:59.267390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 17:59:59.267390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 17:59:59.267390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:59.267390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 399/796] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:59.275564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.375966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc52fd1-e007-40a6-96ba-c95921086477 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.424015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.425074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.425601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.426095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.427503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:59.428046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.429707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.444667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 398/797] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:59.446288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f0b583-09e7-4c39-9a0f-d3ac4457bfd2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.454450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.509447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.510425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.510957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.511378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.512260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:59.512718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.514260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.537844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 400/798] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 17:59:59.544409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.619026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee90c49-4bdc-44f6-b0ce-aa3eae67c83f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.654146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.655405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.655835 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.656255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/ec0be08acb9049439ec2e7d22c616177/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.671748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=ec0be08acb9049439ec2e7d22c616177, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.673434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e06c2b-36ec-43c3-8d0f-c247434b15e4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.680196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9aaf70-0298-409e-a05e-0b83d46f4a0b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.691374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 399/799] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 17:59:59 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/ec0be08acb9049439ec2e7d22c616177/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 17:59:59.702168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615d59-37d9-4622-8a6a-9a086501d8e0 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.702714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615d59-37d9-4622-8a6a-9a086501d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.703154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9615d59-37d9-4622-8a6a-9a086501d8e0 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.704972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 400/800] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 17:59:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 17:59:59.722014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.723111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.723577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.730663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.730663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.730663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.730663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.736645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.738281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 17:59:59.755168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 17:59:59.756367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 17:59:59.757342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 17:59:59.761802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 401/801] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 17:59:59.763063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 17:59:59.763405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.764606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 17:59:59.877280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083b2b5-5e53-46b5-b54e-626b5291ab16 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 17:59:59.893438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 401/802] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 17:59:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 17:59:59.929843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 17:59:59.930540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 17:59:59.930893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 17:59:59.931170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 17:59:59.932011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 17:59:59.932313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 17:59:59.933751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 17:59:59.951558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 17:59:59.962708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 402/803] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 17:59:59.962708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.062533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a1d7a2-932b-4a3b-bf94-7296c4a9b03a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.103131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.103935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.104444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.104444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.114936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.116385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.120699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3250d-e3dd-4040-b422-13b969e0dc28 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:00.135455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:00.136437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:00.137353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:00.137353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:00.137353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:00.137353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:00.141382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 403/804] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:00.142550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.162908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.164088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.164572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.165059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.177991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:00.186324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:00.187325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:00.188488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:00.198970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 402/805] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 17:59:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:00.200240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.250826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09bb79-1a7e-437c-9873-854783ee6aaa None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.283450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.284127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.284402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.284669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.285484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:00.285484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.287157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e753a8-22ea-47f0-b0ee-7b0385513cf0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.311373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 404/806] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:00.312942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906469c5-83b6-45f4-ac76-9bf31ccc21a4 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.313505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906469c5-83b6-45f4-ac76-9bf31ccc21a4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.313790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906469c5-83b6-45f4-ac76-9bf31ccc21a4 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.315339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 405/807] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:00.319538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906469c5-83b6-45f4-ac76-9bf31ccc21a4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.378075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528d894-29ad-46cf-b929-289f17002a5b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.424091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.425314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.426126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.426707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.427621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:00.428102 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.430100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de7d5b5-5a2f-4027-af0b-c36649fd6767 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.441546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 403/808] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:00.443244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.443685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.444088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.447469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906469c5-83b6-45f4-ac76-9bf31ccc21a4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.468032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:00.469843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:00.487102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.488339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.488779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.489521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.498418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.500493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:00.517922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:00.518904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:00.520396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:00.527581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 406/809] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:00.527581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.550320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 404/810] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:00.552761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.636146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b426e-1bf2-4fc6-92a5-36a18470e6a3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.668547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46c606d-407b-45ae-8522-206cfde1390a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.682963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.684689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.685340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.685946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.700647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.702654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.705478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.705950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.706309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.706778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.708895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:00.709282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.710862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:00.724522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:00.725465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:00.726699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:00.726699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:00.726699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:00.726699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:00.733695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 405/812] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:00.733695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.734439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 407/812] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:00.736075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.843252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca6f4-8676-4062-9c18-8e9c44c59dc6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.861859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cebfb9-7f93-4a46-9365-4f4009182206 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:00.878508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.880971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.880971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.881211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.882068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.883579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:00.896579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:00.897571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:00.898902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 406/813] 10.222.0.25 () {56 vars in 1129 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:00.900691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:00.906682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:00.907772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:00.908195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:00.908619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8ecb9355635e486aa8e5f9e4d38ead62/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:00.911938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=8ecb9355635e486aa8e5f9e4d38ead62, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:00.913419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:00.932187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 408/814] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:00:00 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/8ecb9355635e486aa8e5f9e4d38ead62/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:00:00.933036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.027072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dea1a-2907-4823-8a4c-1d47eaa8fb53 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.067781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.068979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.069506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.070003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.071128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:01.071657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.073236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.093204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 407/815] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:01.095198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.189077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351023ef-e89c-4170-8d71-6e1672c31671 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.218159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b46efd-9e79-42bf-b452-42faf7126b43 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.236424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.237329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.237466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.237647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.239377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:01.239958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.241720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.247194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 409/816] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 18:00:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:01.252599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.263145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.264664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.265478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.266250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.277175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.279325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:01.299469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:01.301041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:01.302289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:01.307054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 408/817] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:01.310705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.374418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf1369-d500-4944-a2f4-49566fe53ac1 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.408098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.408769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.409056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.409331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.410596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:01.411183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.412562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48b267-2de9-4bd4-abef-93af8941f47f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.419661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 410/818] 10.222.0.25 () {56 vars in 1124 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:01.421045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073971d-1990-4275-8b04-a1ba6526c1cf None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.421344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073971d-1990-4275-8b04-a1ba6526c1cf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.421622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a073971d-1990-4275-8b04-a1ba6526c1cf None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.428433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 411/819] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:01.433422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073971d-1990-4275-8b04-a1ba6526c1cf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.436037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b52917-c38f-4f99-ab79-37280b0472ed None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.476701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.477376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.477658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.477999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.478851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:01.479159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.480787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7fc7fa-0803-4b45-89bc-fa66346b43e8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.499025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 409/820] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:01.500289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.500583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.500922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.518056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:01.519635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:01.553624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a073971d-1990-4275-8b04-a1ba6526c1cf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.594990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 410/821] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:01.594990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.613462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.614185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.614414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.615009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.616405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.618884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.647321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 412/822] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:01 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:01.648490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:01.731794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c4ddd4-2d63-4487-a0da-25fb1aa694fc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.773577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.774704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.775190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.775691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.792603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0a2ea-cf70-4b31-a574-c193368afeb5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:01.845339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:01.846165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:01.846450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:01.846775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] PATH_INFO: `/v3/services/network` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:01.848226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.849389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.858499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:01.860431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:01.879723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:01.880812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:01.881701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 413/823] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/services/network => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:01.889970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.006552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 411/824] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:02.011865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.024237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546a749-705b-4051-9737-8b818b09a181 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.068193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.069597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.070299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.070752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.071805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] RBAC: Adding query filter params (name=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:02.072570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.074362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.081018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 414/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:02.087725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.136745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29f4ef-2b17-4c45-a225-b3748c864b75 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.202761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a16d-520f-4721-a38b-c1da9e13c2d5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.227905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.228727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.229008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.229291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.240608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.241603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.241889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.242164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.242895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] RBAC: Adding query filter params (type=network) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:02.243199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.244565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.249540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 415/826] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:02.255777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.267669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.269167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:02.305176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:02.306167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:02.307113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:02.307113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:02.307113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:02.307113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:02.307113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 412/827] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:02.312053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.380578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6952d8-f995-48ec-8189-bed5e653287e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.419070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.420152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.420555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.420851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.421602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.423449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc43b66-8e9f-41a4-9957-4c3f6d483be6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.448309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 416/828] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:02.449702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2db7-baed-4649-a8ad-b38d50966f86 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.449994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2db7-baed-4649-a8ad-b38d50966f86 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.450269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e2db7-baed-4649-a8ad-b38d50966f86 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.452127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 417/829] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:02.458614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.458816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.459120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.468656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f8502-d4f1-4314-ad31-48d4227c1923 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.477354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:02.478742 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:02.516085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.517183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.517714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.518186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.519699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:02.520435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.522217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.535688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 413/830] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:02.540929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.617500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 418/831] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:02.653168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.659634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f96f-8917-44d7-99ad-98c186a0dd57 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.702515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.703914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.704419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.704974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.713853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.715992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:02.734088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:02.735275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:02.736316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:02.739875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 414/832] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:02.746734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.781728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed64fff-b1f0-484a-8b83-3b806b414dd5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.825067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.825825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.826111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.826386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.839154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:02.847060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:02.848600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:00:02.849510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:02.853933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 419/833] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:02.855220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.871627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a74402-15db-4cac-8637-555fa01813a1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:02.906087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:02.907189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:02.907671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:02.908141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:02.909133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:02.909637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:02.912609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:02.926646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 415/834] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:02.933996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:02.969626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a31af-26fb-4d74-912a-dd713ab34666 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.009929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.010643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.010933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.011204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.011949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:03.012346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.013813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.029509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 420/835] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:03.030396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.059667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63717ced-5040-4a09-83d4-bc14d70a1929 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.101518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.102904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.103637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.104082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.105215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:03.106432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.108034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.115689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 416/836] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:02 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:03.142204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa7b4c-b38e-4de4-85db-ee65abfa7e94 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.181842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.183009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.183435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.183905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.197727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.199589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:03.219910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:03.221045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:03.222164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:03.222164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:03.222164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:03.222164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:03.224202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 421/837] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:03.229953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.340133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e3c11-8abb-4416-96b9-b364b4ec73cc None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.375515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.376616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.377103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.377578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.378548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:03.379369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.380975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.398382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 417/838] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:03.400098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.503679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a883c-5468-4f50-b6e7-bd6c0c11466b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.539303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.540149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.540428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.540701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.549508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.551563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-7211cbf9-c41e-4e94-97ed-ed7a3e34a389 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:03.567557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:03.568598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:03.569876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 422/839] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:03.576742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.676500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d0f21-71f5-4bd2-9b3b-cc0efc32a691 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.710692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.711459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.711742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.712010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.712842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:03.713146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.714663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:03.719047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeab1c-44c8-43ab-b132-3b6e78f601e8 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.719533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeab1c-44c8-43ab-b132-3b6e78f601e8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.719614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eeab1c-44c8-43ab-b132-3b6e78f601e8 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.721176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 423/840] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:03.727729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488292-648c-4491-b786-33939930f802 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.728017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488292-648c-4491-b786-33939930f802 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.728296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91488292-648c-4491-b786-33939930f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.735499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 418/841] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:03.743613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.745960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-91488292-648c-4491-b786-33939930f802 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:03.747370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-91488292-648c-4491-b786-33939930f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:03.827175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 424/842] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:03.845847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91488292-648c-4491-b786-33939930f802 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:03.865565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012ca96-553e-494c-8a35-c589eac0526b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.908787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.909696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.910837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.911260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.946353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91488292-648c-4491-b786-33939930f802 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:03.993153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:03.994260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:03.994544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:03.994845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:03.995395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:03.997057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.008002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:04.020440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.021449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:04.022305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 425/843] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:04.029166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.111831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 419/844] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:03 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:04.113145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.134316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae983923-e6a5-4551-9968-31505b63093d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.172858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.173991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.174500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.175052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.176341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:04.176881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.178519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.192422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 426/845] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:04.193653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.216786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac6c3f2-6309-49b8-90f6-d251c634380d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.250787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.251622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.251865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.252144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.262368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.263889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:04.281728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.282693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.283627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:04.283627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:04.283627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:04.283627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:04.286697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 420/846] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:04.288987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.302065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13cee3-7e5e-4b8c-b4d3-49d6cd1425d3 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.337226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.338028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.338313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.338611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.349462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.350942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-1b7a02c8-9c39-4560-9d09-a98b2fc05074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:04.367984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.368975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.369888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:04.369888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:04.369888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:04.369888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:04.374049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 427/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:04.375592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e09f-475a-4efc-8007-3578b7a952ca None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.375958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e09f-475a-4efc-8007-3578b7a952ca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.376159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3e09f-475a-4efc-8007-3578b7a952ca None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.377707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 428/848] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:04.378236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e09f-475a-4efc-8007-3578b7a952ca None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.394605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fef0c6b-ccec-4563-9d41-c52c0333d57e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.429810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.430509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.430793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.431072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.431782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:04.432086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.433449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80ae2d-93db-493e-a3c7-b0195c2a85ae None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.444989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 421/849] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:04.446404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.446788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.447135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.463652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:04.464833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:04.491914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3e09f-475a-4efc-8007-3578b7a952ca None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.528523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.529192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.529471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.529746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.530456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:04.530807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.531424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 422/850] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:04.532096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.532297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.550351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 429/851] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:04.555579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.637263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca3812-03d9-45b2-8401-5803e3513265 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.652579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0d2f89-392e-4e30-88bc-00a4b5676b69 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.673673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.674470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.674791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.675068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.682139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.683614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.685361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.686349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.686832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.687297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.688108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.689883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:04.698471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.699406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:04.700318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 423/852] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:04.701232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.705193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.706404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:04.707621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:04.709791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 430/853] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:04.710760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.803689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936d5848-100e-4b4a-81df-4b600edfe68a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.819269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d36d80c-02c2-4f17-9d17-7a2cd89249ee None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.836947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.837747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.838027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.838301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.845776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.847316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.852649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:04.853553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:04.853832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:04.854111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:04.854925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:04.855237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:04.856644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:04.861512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:04.862466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 424/854] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:04.869099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.875926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 431/855] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:04.876914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:04.971768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6cf8b-21a6-4ed7-a6da-3b361f3ab5e1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:04.975652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9806e4d-9356-43ba-a28d-d531733e6640 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.005130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.005800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.006078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.006353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.007077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.007381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.008746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.009532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.010206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.010491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.010817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.011679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.011986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.013411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.018661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 425/856] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:05.018661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.039945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 432/857] 10.222.0.25 () {56 vars in 1135 bytes} [Tue May 17 18:00:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:05.039945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.115903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f2670-0dba-4b06-9128-cb49d428dab4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.146529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27efc2a-c83a-481d-ae35-7bf659189aa4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.148752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.149407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.149693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.149969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.150816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=ec0be08acb9049439ec2e7d22c616177) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.151209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.152635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.158481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 426/858] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/role_assignments?user.id=ec0be08acb9049439ec2e7d22c616177&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:05.159373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.200568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.201614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.202681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.203145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.204043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.204890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.207191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6534dcc4-dc8b-4410-be28-4b1f5e312a4c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.223420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 433/859] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:05.282148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392aa9a5-3415-4a2a-81c1-194886d5c904 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.329270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.329998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.330287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.330566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.408644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.410450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.500626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2b3c5-18d9-4407-aa8d-b574df57820f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.501262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2b3c5-18d9-4407-aa8d-b574df57820f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.501627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2b3c5-18d9-4407-aa8d-b574df57820f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.503163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 434/860] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:05.508813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.509104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.509379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.518210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 427/861] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:05.523753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.532851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:05.534304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:05.600889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 435/862] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:05.623328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.637914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f30515-7df5-42c9-b108-14f3ae6b632d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.672942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.673807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.674081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.674356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.685873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.687354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:05.708786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:05.709755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:05.710722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:05.710722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:05.710722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:05.710722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:05.710722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 428/863] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:05.719555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.733517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57ea78-ca0b-4b4e-85c1-33c582013f27 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.776142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.777071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.777355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.777630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.778719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.780367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:05.810219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:05.811677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:05.812749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:05.816912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 436/864] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:05.822900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.835176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51df390f-d674-49a0-a9c4-1dbc8e8e9fcd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.892127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.893600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.894115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.895069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.895932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.896380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.898563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.917340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 429/865] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:05.918054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:05.940599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f8376-1d39-4a20-aeb3-4707158ce29e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:05.983666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:05.984587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:05.984764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:05.985151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:05.985993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:05.986291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:05.987778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:05.992853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 437/866] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:06.002591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:06.027908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb69ee3-b668-49f9-8dfe-48e6c48a70f4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:06.061428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:06.062271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:06.062554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:06.062865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:06.071362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:06.072958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:06.088152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:06.089132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:06.090051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 430/867] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:06.096228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:06.120219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4843-74d8-49f5-a867-b84b171023cc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:06.154478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:06.155274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:06.155651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:06.155995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:06.156781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:06.157150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:06.158657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:06.170701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 438/868] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:05 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:06.206009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fc73e7-5d1c-4aea-ac16-ca0e8822ed4f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:06.246727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:06.247409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:06.247691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:06.247966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:06.248763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:06.249069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:06.250529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5ea2d3-1a3e-4edb-9fa9-365f82f620f5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:06.270594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 431/869] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:06.272036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:06.383998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373698d9-6d19-42bf-af80-b1eacd8bb940 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:06.417281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:06.417937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:06.418213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:06.418476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:06.419326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=8ecb9355635e486aa8e5f9e4d38ead62) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:06.419627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:06.421033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4a5fe-c878-4a14-95bf-087d6c12e888 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:06.427827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 439/870] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:06 2022] GET /identity/v3/role_assignments?user.id=8ecb9355635e486aa8e5f9e4d38ead62&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:07.553061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2ade-a150-4af8-9928-5eeec5169657 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.553772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2ade-a150-4af8-9928-5eeec5169657 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.553772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb2ade-a150-4af8-9928-5eeec5169657 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.555308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 432/871] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:07.560690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.561160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.561314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.578938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:07.580115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:07.640936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee905d-beca-4701-bf0f-6536ac351611 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.641243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee905d-beca-4701-bf0f-6536ac351611 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.641492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee905d-beca-4701-bf0f-6536ac351611 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.643118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 433/872] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:07.648947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.649277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.649535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.651465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 440/873] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:07.667233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:07.668402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:07.677041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:07.752602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 434/874] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:07 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:07.779337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:07.796255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730d3f8-bacf-4859-9f3b-30ab9cb53695 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:07.841598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:07.842660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.843097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.843524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.844538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:07.846678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:07.871835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 441/875] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:07 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:07.886788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bed7c3-295d-4569-b215-c4d6162006a1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:07.932640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:07.933469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:07.933748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:07.934018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:07.946566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:07.955272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:07.956310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:07.958495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 435/876] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:07.962974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.081300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830610f-2e62-488d-92af-b896d4f44d28 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.118253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.119373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.119887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.120368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.121315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:08.121823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.123444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.132505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 442/877] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:08.137622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.244980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934bf0c-5a87-43db-859d-184335d74356 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.282322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.283602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.284123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.284671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.297602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.299487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9457a600-c87f-4268-91ff-ed4a2b120a66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:08.319856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:08.320865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:08.321831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:08.321831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:08.321831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:08.321831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:08.324224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 436/878] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:08.331385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.430608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c617524b-0685-4dfa-960b-90afb4a60802 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.464905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.465578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.465859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.466135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.466901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:08.467259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.468633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.469220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11190-d6b0-4308-9824-52445ab720b9 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.469714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11190-d6b0-4308-9824-52445ab720b9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.470197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be11190-d6b0-4308-9824-52445ab720b9 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.472166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 437/879] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:08.478566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693833-9954-458f-9351-c156673f2951 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.478566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693833-9954-458f-9351-c156673f2951 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.478566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13693833-9954-458f-9351-c156673f2951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.481291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 443/880] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:08.486851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.497390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-13693833-9954-458f-9351-c156673f2951 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:08.498886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-13693833-9954-458f-9351-c156673f2951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:08.570410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 438/881] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:08 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:08.592776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693833-9954-458f-9351-c156673f2951 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.599320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0440b5f5-5711-4477-bed7-96350c1a0308 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.634736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.635966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.636448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.636962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.645471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.647287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:08.663054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:08.664038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:08.664993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:08.667675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 444/882] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:08.672784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.706226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13693833-9954-458f-9351-c156673f2951 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.741031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.742075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.742601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.742901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.743629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.744984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6109f578-15fa-4dc0-aebb-5a599e179c5e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.759250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 439/883] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:08 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:08.766656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a90f0-78a2-444c-8435-9ca6dec5b0a2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.766656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a90f0-78a2-444c-8435-9ca6dec5b0a2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.766656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a90f0-78a2-444c-8435-9ca6dec5b0a2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.766656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 440/884] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:08.769544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.770056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.770474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.789118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:08.790662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:08.808540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938872fc-8b04-4273-b173-fe8fbb10477a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:08.861820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:08.862856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:08.870840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 441/885] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:08.870941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:08.870941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:08.870941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:08.870941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:08.870941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:08.887075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:08.901561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 445/886] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:08.907661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.012210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c954d8e-2826-4cda-8419-6ad9c5f0042b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.026193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87647c5-9fa0-44b1-8ce3-0c452870a173 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.056149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.057375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.058112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.058729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.059637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.061419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.062895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.063878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.064079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.064351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:09.077617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:09.078878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:09.079736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:09.080496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 442/887] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:09.086231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.153782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.156106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.197184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26e027-cfd0-44d5-9204-a5e5ffab031c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.239457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.240536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.241018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.241823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.242727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:09.243174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.245319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.252424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 443/888] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:09.258623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.276330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 446/889] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:08 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:09.277521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.381152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef46bb6-c9bd-4b42-90d3-ff5d6d59fd2f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.385668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434e44bc-f200-40d2-9e80-d38cc2d8483d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.414888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.415562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.415845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.416121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.416817 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:09.417120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.418483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.430601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 444/890] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:09.438861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.439733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.440017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.440292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.451867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.453339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:09.474198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:09.475252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:09.476183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:09.476183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:09.476183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:09.476183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:09.476183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 447/891] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:09.481409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.589140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7be63d-120d-4e7f-9472-a7e4e7fe6650 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.625248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.625979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.626263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.626536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.628996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:09.628996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.629849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.645955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 445/892] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:09.648526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.748139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc12c1-3b58-4160-a7e7-c03b23b0a7bf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.786170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.787003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.787277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.787542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.794354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.795800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:09.809482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:09.810423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:09.811682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 448/893] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:09.819652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:09.919934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5575cd0-28c0-487a-9359-f1536c4b64a6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:09.955938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:09.957331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:09.957706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:09.958138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:09.958988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:09.959302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:09.960805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524c2d-9d6a-4b8d-b913-787a911cd1a6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:09.975039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 446/894] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:09.981003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:10.081222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071bc0e9-5466-44c2-8346-a36ac613aba4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:10.117646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:10.118337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.118645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.118920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.119776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] RBAC: Adding query filter params (role.id=14dbc8b74d6a4c848e971cdc7e1f8712, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=ec0be08acb9049439ec2e7d22c616177) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:10.120086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:10.121566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1090d3-8d9b-4d55-919f-cbe09fe3cfe9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:10.128277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 449/895] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:09 2022] GET /identity/v3/role_assignments?user.id=ec0be08acb9049439ec2e7d22c616177&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=14dbc8b74d6a4c848e971cdc7e1f8712 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:10.307986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d330e-e95b-4380-b502-11a6f84f0883 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.308374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d330e-e95b-4380-b502-11a6f84f0883 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.308552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d330e-e95b-4380-b502-11a6f84f0883 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.310085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 447/896] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:10.315718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.316551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.317077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.335613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:10.336800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:10.404727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 450/897] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:10.428805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d330e-e95b-4380-b502-11a6f84f0883 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:10.533773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d330e-e95b-4380-b502-11a6f84f0883 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:10.568870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:10.570077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.570603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.571082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.571926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:10.573542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:10.586775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:10.587840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:10.588708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:10.592046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 448/898] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:10 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:10.600621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:10.701846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21e1386-aecc-4f95-9508-d349681ecc54 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:10.740380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:10.741052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.741334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.741608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.742311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:10.742638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:10.744010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:10.749252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 451/899] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:10 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:10.754559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:10.856593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea27709-0e24-4119-b7f9-e46549ecef5e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:10.890529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:10.891599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:10.892087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:10.892578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:10.893468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:10.894754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:10.896377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:10.901699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 449/900] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:10 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:10.907147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.022499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01e02d-6e2c-435d-be52-bc15ae2d75e6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.056830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.057550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.057838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.058113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.058922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] RBAC: Adding query filter params (interface=public, service_id=300d54a12d1c49b3aca53f28cc792662, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:11.059232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.060642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ffc64-e130-4dc5-9266-5b4cebb2d8eb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.066558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 452/901] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:00:10 2022] GET /identity/v3/endpoints?service_id=300d54a12d1c49b3aca53f28cc792662&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:11.072053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.137775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5f28-a56c-43e2-be32-c99a1d73e052 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.138075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5f28-a56c-43e2-be32-c99a1d73e052 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.138244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d5f28-a56c-43e2-be32-c99a1d73e052 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.140964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 453/902] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:11.145621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.145908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.146187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.163762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:11.164941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:11.178243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22cab64-1e34-4e17-a71a-67060450b182 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.219009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.220182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.220721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.221229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.222346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.224404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.230867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 450/903] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:00:11.247428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 454/904] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:11.271176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.390288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d601aaba-f4ce-4b91-a168-14d54c1f929b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.428886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.429979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.430423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.430885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.431702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.433226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:11.447570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:11.448880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:11.450068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:11.452508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 451/905] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:11.459844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.562979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e582c-c21b-4a31-a3fa-4def10aa1a79 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.599083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.600122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.600608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.601084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.601995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:11.602500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.604078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.609355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 455/906] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:11.615447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.720947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3a4e56-742f-429c-847e-d48b7b488179 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.755184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.756264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.756762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.757244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.758134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:11.758660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.760234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07eef4f3-7c71-47c2-8c40-fb6568b0ce4c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.765720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 452/907] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:11.775725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.820308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf31bc-886f-44c3-84b3-de2df063b608 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.820605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf31bc-886f-44c3-84b3-de2df063b608 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.820923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf31bc-886f-44c3-84b3-de2df063b608 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.822534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 453/908] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:11.827651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.827933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.828219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.844791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:11.846023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:11.890483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed8ade-4865-47d8-88c8-a91a69187e12 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:11.926952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 454/909] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:11.935874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:11.936980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:11.937483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:11.937966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:11.939792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] RBAC: Adding query filter params (interface=public, service_id=18df71c94f8748e1be3862867b66cea0, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:11.941174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:11.942350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:11.943524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:11.951726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 456/910] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/endpoints?service_id=18df71c94f8748e1be3862867b66cea0&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:11.959870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:12.061576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e8548-7c51-4127-82d5-9296e65a70ce None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:12.063971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e2f74-1e58-4ef5-82ee-d20458acea61 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:12.100602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:12.101369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.101726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.102067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.102850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:12.104280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bfe61f-3805-4f0f-81ce-be110270a075 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:12.104474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:12.105150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.105609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.105883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.106953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:12.108560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb911b1-a77c-4cdd-a427-891428e0b285 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:12.110675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 457/911] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:11 2022] GET /identity/v3/services => generated 1268 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:00:12.130016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 455/912] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:11 2022] POST /identity/v3/services => generated 241 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:12.470162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a81b5-981a-4338-ad73-721fbc70c688 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.470558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a81b5-981a-4338-ad73-721fbc70c688 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.470802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a81b5-981a-4338-ad73-721fbc70c688 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.472635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 458/913] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:12.478421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.478774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.479027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.496701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:12.497878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:12.570958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 456/914] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:12.593890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a81b5-981a-4338-ad73-721fbc70c688 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:12.698498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a81b5-981a-4338-ad73-721fbc70c688 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:12.732639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:12.733376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.733654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.733923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.744112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:12.752426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:12.755119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:12.756677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 459/915] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:12.762593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:12.862612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832cc74f-03c5-4ea9-97e4-d0d5a837867e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:12.898082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:12.898785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:12.899072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:12.899347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:12.900087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:12.900393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:12.901767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:12.910677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 457/916] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:12.916038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.025271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02264bf2-1706-48f4-bf97-fa9f177dde23 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.059035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.060208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.060692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.061173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.072482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.074222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:13.092005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:13.093149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:13.094112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:13.094112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:13.094112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:13.094112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.096323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 460/917] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:13.102883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.202431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319aa5d7-ae66-4b96-9367-d771c058499b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.236160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.236830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.237113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.237387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.238798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:13.239105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.240490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.252615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 458/918] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:13.258791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.363702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628013f9-c7c3-40b3-9587-a168f9d31bb4 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.397892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.399331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.399808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.400110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.408115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.410070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:13.424592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:13.425827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.426838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 461/919] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:13.433843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.544262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc5a485-2e8d-4c6b-aa1f-aa73ead2106b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.578336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.579035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.579319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.579593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.580416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:13.580723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.582279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fdd087-e478-4f91-8dd0-9f821f63bd2b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.600452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 459/920] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:13.605884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.673762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467a22-4663-4d8e-8ce4-2283ca6c257d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.673946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467a22-4663-4d8e-8ce4-2283ca6c257d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.674225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca467a22-4663-4d8e-8ce4-2283ca6c257d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.676046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 460/921] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:13.680941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.681222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.681499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.701114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:13.702295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:13.711654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcfa4d5-1109-4318-9e83-b1e04606b528 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.745356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.746508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.747092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.747582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.758667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.760441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.769460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 461/922] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:13.779468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:13.780406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:13.781379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:13.781379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:13.781379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:13.781379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.783630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 462/923] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:13.789571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.793078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.889089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baaf493-b6e5-4601-8b50-d3a95e3d1bbe None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.895834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdaff3-0969-4f3b-9453-32c2532e2e22 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:13.927017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.927710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.928154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.928325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.929374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:13.929493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.930921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.934722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:13.936123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:13.936677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:13.937127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:13.938014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:13.939887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:13.951386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 462/924] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:13.956986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:13.958005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 17 18:00:13.958904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:13.961154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:13.966329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 463/925] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:13.966329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.067778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5556-3ed8-4cab-9ed9-f3ca1d92bfdd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.068581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec2f52-b283-4157-8d2e-1b1dfdd280f6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.102354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.103084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.103364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.103690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.103928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.104394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:14.104697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.105384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.105861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.106096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.106541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.113740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.115460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.116041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 464/926] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:14.117136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:14.131419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:14.132398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:14.133319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:14.135775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 463/927] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:14.141069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.231450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c4c45-e462-4195-b869-909dd2d2a649 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.254502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7c67f-53ef-45e2-9ba0-c976e23959f3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.266598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.267695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.268183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.268662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.270011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:14.270560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.272246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.283176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 465/928] 10.222.0.25 () {56 vars in 1114 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:14.285096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.294207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.295382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.295915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.297093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.298217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:14.299289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.301975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.323645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 464/929] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:14.325326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.406305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e971cac-e557-4620-84a4-2cf16e0e2564 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.436356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3426bc3-e668-44f4-900e-95b70753702e None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.443095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.444110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.444672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.445146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.446087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.447765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd01b5-e695-467b-be53-0c4b4f829f61 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.469239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 466/930] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:14.470943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b213ee-3da5-4346-9433-05f761415762 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.471439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b213ee-3da5-4346-9433-05f761415762 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.472506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b213ee-3da5-4346-9433-05f761415762 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.474361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 467/931] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:14.478447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.479416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.479697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.479969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/ec0be08acb9049439ec2e7d22c616177/roles/14dbc8b74d6a4c848e971cdc7e1f8712` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.480854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.481438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.482124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.482413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=ec0be08acb9049439ec2e7d22c616177, role_id=14dbc8b74d6a4c848e971cdc7e1f8712)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.483974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b517-26d0-4d96-b17c-6c67f9ee28d7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.499797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:14.500461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 465/932] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:00:14 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/ec0be08acb9049439ec2e7d22c616177/roles/14dbc8b74d6a4c848e971cdc7e1f8712 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:00:14.505881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:14.506122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eab58-9aa6-45aa-ae9a-df8b851419d1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.506122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eab58-9aa6-45aa-ae9a-df8b851419d1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.506122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9eab58-9aa6-45aa-ae9a-df8b851419d1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.506122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 466/933] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:14.517162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.517740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.518168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.544680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:14.547494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:14.584059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 468/934] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:14.607265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.641569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 467/935] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:14.658445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.727173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44474620-0065-436c-9f4a-f9ab4a45bb7e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.771664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.772410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.772690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.772961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.773612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.774779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d14996-2fd3-4da5-854a-b3d331f9284b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.775214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:14.788371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:14.789382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:14.790239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 469/936] 10.222.0.25 () {56 vars in 1132 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:14.795843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.823329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.824761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.825391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.826182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.827297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.829546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:14.845436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:14.846503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:14.848039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:14.851166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 468/937] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:14.862611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.920739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9048fb94-0aab-42fd-a5de-9f61ac3c7db6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:14.957464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:14.959004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:14.959529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:14.960017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:14.960911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:14.961427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:14.963142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:14.968565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 470/938] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:14.974537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:14.987069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df64797-b5c9-4dd0-be85-f319d8addef2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.032953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.033614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.033923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.034515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.035269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:15.035633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.037517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.046653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 469/939] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:15.049511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:15.085448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2873a0-49fe-439c-9563-d046dd1384d6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.119550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.120305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.120487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.120765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.121469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:15.122002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.123223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.129296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 471/940] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:14 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:15.134712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:15.161476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cba8cc-1d56-4267-a1bd-caba549c92c0 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.197647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.198559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.199019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.199437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.200277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:15.200750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.202251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.212633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 470/941] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:15.213716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:15.258606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c651062-f712-45e3-b75a-c5f97c61ff90 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.302128 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.302913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.303323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.303697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.305052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.306806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.317225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ecef66-4509-4318-83f8-104708cf2c98 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.335350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 472/942] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:15 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:15.367477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.368484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.369042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.369557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.370627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] RBAC: Adding query filter params (interface=public, service_id=f580a2cb080e4f2cbc235848de3b8d3c, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:15.371130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.372779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d519c753-a06e-4e81-a316-0c3c5616acfc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.379631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 471/943] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:00:15 2022] GET /identity/v3/endpoints?service_id=f580a2cb080e4f2cbc235848de3b8d3c&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:15.386059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:15.494456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92988664-c85e-4a27-9a59-2791fa9e2582 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:15.534800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:15.535576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:15.535852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:15.536118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:15.536799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:15.538163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637c494-73a3-438b-a5f9-249c4458eeb0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:15.544934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 473/944] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:15 2022] GET /identity/v3/services => generated 1497 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:00:16.810840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8b206-76da-46f0-ab18-adccb88560b1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:16.811385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8b206-76da-46f0-ab18-adccb88560b1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:16.811385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad8b206-76da-46f0-ab18-adccb88560b1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:16.812967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 472/945] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:16.818720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:16.819131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:16.819320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:16.836356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3f8a-bab0-4057-8367-7c84756f1eef None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:16.836664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3f8a-bab0-4057-8367-7c84756f1eef None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:16.836907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755c3f8a-bab0-4057-8367-7c84756f1eef None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:16.837083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:16.838242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:16.838497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 473/946] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:16.844500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:16.844783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:16.845057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:16.866973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:16.868155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:16.910178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 474/947] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:16.933418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:16.940718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 474/948] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:16.969386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.045757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c15e71-1aaf-4669-9f98-4f50228ad5ec None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.071500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365adaef-a9ec-4946-9a80-74bcfc1d6e9b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.093424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.094376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.094692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.094967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.107047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.107990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.108181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:17.108333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.108528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.109231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.110680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.112032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING keystone.server.flask.common [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:17.117215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:17.119186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:17.120415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 475/949] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:17.125433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.138027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.sql.core [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:00:17.138027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 18:00:17.138027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [parameters: {'id': '03157f5d19714bb182bbbbcf09fd7e1b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 18:00:17.138027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79968) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03157f5d19714bb182bbbbcf09fd7e1b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03157f5d19714bb182bbbbcf09fd7e1b. May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application conn.query(q) May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:00:17.160648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application result.read() May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 17 18:00:17.162309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return project_ref.to_dict() May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application next(self.gen) May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application yield resource May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application next(self.gen) May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self.session.rollback() May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self.force_reraise() May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise self.value May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application session.commit() May 17 18:00:17.163480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._prepare_impl() May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self.session.flush() May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._flush(objects) May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application compat.raise_( May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application flush_context.execute() May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 18:00:17.164437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rec.execute(self) May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application c = connection._execute_20( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 18:00:17.165381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application conn.query(q) May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application result.read() May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:00:17.166212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [parameters: {'id': '03157f5d19714bb182bbbbcf09fd7e1b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.167165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:17.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.Conflict( May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 03157f5d19714bb182bbbbcf09fd7e1b. May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.168931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 475/950] 10.222.0.25 () {60 vars in 1140 bytes} [Tue May 17 18:00:16 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:17.175307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.240329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac958aa5-b1de-450d-827b-8aec098ab547 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.274888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.275673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.276021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.276370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.277367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:17.277519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.279020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.283451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8e5ec-fd2d-4b36-b664-28490757aea3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.288515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 476/951] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:17.295320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.327911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.329430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.330050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.330859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.340066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.342465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:17.362300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:17.363511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:17.364427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:17.367189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 476/952] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:17.373164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.408694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98353234-311e-47b8-a82a-c03af2c7ce2d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.454615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.455867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.456485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.456964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.470650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.472966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.484489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae333c6b-604a-4f71-8411-6cc55d66ed84 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:17.496785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:17.497762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:17.498741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:17.498741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:17.498741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:17.498741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:17.505302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 477/953] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:17.506801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.533451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.534144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.535152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.535437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.536208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:17.536556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.537986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6e2ec-8d4d-4443-9e2d-6410f578ec9b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.566803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 477/954] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:17.624587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789bbef-d49e-45d6-a1cc-b3f76f210b30 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.662602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.663682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.664168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.664644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.665620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:17.666136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.667770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.681714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 478/955] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:17.685506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17610da-38b6-4bd7-9afd-da7f2b7d0b74 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.685853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17610da-38b6-4bd7-9afd-da7f2b7d0b74 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.686081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17610da-38b6-4bd7-9afd-da7f2b7d0b74 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.687982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 478/956] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:17.691046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.697491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.697491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.697491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.718176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:17.719931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:17.809455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 479/957] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:17.810034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6ff463-a255-4462-94e6-2b0c1f5dafa9 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.831970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.852452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.853366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.853744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.854028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.861615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.863444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:17.879093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:17.880098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:17.881069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 479/958] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:17.886058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:17.948337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa6e51-ff1f-4146-b7ca-2dfc547e9947 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:17.986337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:17.987177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:17.987562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:17.987935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:17.988741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:17.990112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:17.990760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267905f-4136-48f5-abd2-11cc69ff12ec None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ce31332f-6039-4e8c-94f7-6232d5e08c69 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:18.001879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:18.003545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:18.004523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.006725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 480/959] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:18.009157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff464-3bfd-4c38-95fa-01c823de1bb1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.009444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff464-3bfd-4c38-95fa-01c823de1bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.009888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcff464-3bfd-4c38-95fa-01c823de1bb1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.011360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 481/960] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:18.015979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcff464-3bfd-4c38-95fa-01c823de1bb1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.028676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.029358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.029637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.029908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.030771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.031081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.032752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baccba1-b391-41a3-b6c9-829566ede7d3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.050525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 480/961] 10.222.0.25 () {56 vars in 1149 bytes} [Tue May 17 18:00:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:18.051595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.051884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.052158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.068553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:18.069730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:18.121464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcff464-3bfd-4c38-95fa-01c823de1bb1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.146676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 481/962] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:18 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:18.146676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.168873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.169635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.170002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.170347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.171153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] RBAC: Adding query filter params (name=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.171532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.172978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.178044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 482/963] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:18.178691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.240003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638d4a6c-207f-4bcf-a3aa-0c7d9bad955a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.274320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.274997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.275274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.275377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30f629-5b0c-453e-8d17-cf418ba5411f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.275538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.309243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.310051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.310332 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.310628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.311324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.312703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:18.325040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:18.326081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.326993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 483/964] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:18.327866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.348689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.350874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.428415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4d2f-0646-4df5-b428-9ea38b0530d7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.448911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 482/965] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:18.449752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.466656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.467329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.467614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.467892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.468594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.468903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.470262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.474771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 484/966] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:18.475560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.574341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09a68-276c-440c-9714-16c32a27a2ff None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.602559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00757c9-cda6-4b5f-8c9a-360d0c843450 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.616322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.617034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.617355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.617563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.618284 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.618615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.620191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.630597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 483/967] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:18.631746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.649849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.650699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.650984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.651257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.665235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.666721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:18.687934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:18.689163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:18.690212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:18.690212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:18.690212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:18.690212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:18.693984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 485/968] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:18.695421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.760765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a93c9b-c909-4d83-bf30-f07bdf344224 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.807372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.808050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.808331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.808606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.809019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb53f-a23e-4861-a214-2517df485ec6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.809310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.809611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.812147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.822656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 484/969] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:18.825292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.851307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.851965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.852243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.852512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.853225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:18.853527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.854924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.871677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 486/970] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:18.873005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:18.933782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53aba7d-a934-417d-9ff0-e5bcdebaca34 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.973017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:18.973639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:18.973915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:18.974180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:18.974941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:18.976421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:18.977031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7c7142-41c5-419f-8e48-53d240085cd2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:18.997114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 485/971] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:18 2022] POST /identity/v3/endpoints => generated 349 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:19.024390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:19.025205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:19.025572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:19.025849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:19.034125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:19.035697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:19.051794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:19.052859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:19.053860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 487/972] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:19.059183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:19.167171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ccf80-8272-485a-bd54-80cb2d755a26 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:19.202305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:19.203085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:19.203366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:19.203702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:19.204485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:19.204842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:19.208623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97a6cb-4308-443f-a991-e3a665f8a1b5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:19.224928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 486/973] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:19.227530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:19.330306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7423a754-c99e-43c6-ac63-fef504767bc1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:19.365091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:19.365996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:19.366431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:19.366999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:19.367972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] RBAC: Adding query filter params (role.id=14dbc8b74d6a4c848e971cdc7e1f8712, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=ec0be08acb9049439ec2e7d22c616177) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:19.368429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:19.370002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f52f0ec-5608-43ee-959b-c7f136a978aa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:19.376649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 488/974] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:19 2022] GET /identity/v3/role_assignments?user.id=ec0be08acb9049439ec2e7d22c616177&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=14dbc8b74d6a4c848e971cdc7e1f8712 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:19.937179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f912-f29d-490a-9966-cde48525929e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:19.937678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f912-f29d-490a-9966-cde48525929e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:19.937760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f912-f29d-490a-9966-cde48525929e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:19.939621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 487/975] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:19.944746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:19.945148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:19.945335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:19.962558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:19.969127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:20.042742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 489/976] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:20.068121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f912-f29d-490a-9966-cde48525929e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:20.170316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f912-f29d-490a-9966-cde48525929e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:20.207065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:20.207740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:20.208020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:20.208290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:20.209009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:20.210399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:20.211717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING keystone.server.flask.common [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 17 18:00:20.224764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.sql.core [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:00:20.224764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 18:00:20.224764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [parameters: {'user_id': 'cba568d45aad4a7bb995a4f2438822f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 18:00:20.224764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79967) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application conn.query(q) May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result.read() May 17 18:00:20.232296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:00:20.233896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application next(self.gen) May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application yield resource May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application next(self.gen) May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.session.rollback() May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.force_reraise() May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise self.value May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application session.commit() May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 17 18:00:20.236338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._prepare_impl() May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.session.flush() May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._flush(objects) May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application compat.raise_( May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application flush_context.execute() May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rec.execute(self) May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 17 18:00:20.238679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application _emit_insert_statements( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result = connection._execute_20( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ret = self._execute_context( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 17 18:00:20.240841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self.dialect.do_execute( May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result = self._query(query) May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application conn.query(q) May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application result.read() May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 17 18:00:20.250362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application packet.raise_for_error() May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cba568d45aad4a7bb995a4f2438822f8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:20.252569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 17 18:00:20.255119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:20.257254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 488/977] 10.222.0.25 () {60 vars in 1131 bytes} [Tue May 17 18:00:20 2022] POST /identity/v3/users => generated 160 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:20.258195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:20.339628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd6d7a1-7e72-427b-b13f-2c1e284f7f2c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:20.374393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:20.375236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:20.375511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:20.375777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:20.383645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:20.385078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a39b7477-5c79-431e-b820-63883bddb873 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:20.399296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:20.401384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:20.403610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 490/978] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:20.411403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:20.508924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47056c6f-09fa-434c-b0f4-d26fc126633b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:20.547968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:20.548649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:20.548926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:20.549197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:20.550127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:20.550429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:20.552117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9df02e-3b39-455e-8b2f-6b3104a082b2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:20.590406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 489/979] 10.222.0.25 () {56 vars in 1101 bytes} [Tue May 17 18:00:20 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:20.849620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e01e-8bc9-4759-aa44-56409f7fc4ec None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:20.849981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e01e-8bc9-4759-aa44-56409f7fc4ec None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:20.850153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc8e01e-8bc9-4759-aa44-56409f7fc4ec None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:20.851621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 491/980] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:20.857155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee735-ec85-48c3-b47e-d37b263d719d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:20.857445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee735-ec85-48c3-b47e-d37b263d719d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:20.857720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee735-ec85-48c3-b47e-d37b263d719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:20.875563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b83ee735-ec85-48c3-b47e-d37b263d719d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:20.877044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b83ee735-ec85-48c3-b47e-d37b263d719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:20.950618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 490/981] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:20 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:20.970197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8e01e-8bc9-4759-aa44-56409f7fc4ec None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.068133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc8e01e-8bc9-4759-aa44-56409f7fc4ec None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:21.100707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:21.101292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.101575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.101844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.102546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:21.103923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fa1c0-258f-468e-9604-2240ff1d3075 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:21.116995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 492/982] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:20 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:21.349586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772937d1-30f9-4073-9a7a-70919ac84e44 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.349973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772937d1-30f9-4073-9a7a-70919ac84e44 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.350164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772937d1-30f9-4073-9a7a-70919ac84e44 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.351749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 491/983] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:21.356812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.357104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.357377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.373817 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:21.375038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:21.445101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 493/984] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:21.468138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772937d1-30f9-4073-9a7a-70919ac84e44 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.568012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772937d1-30f9-4073-9a7a-70919ac84e44 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:21.600272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:21.601082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.601364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.601636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.602326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:21.603672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-52976b7a-ecbe-490b-b88b-d499c7b164a2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:21.615653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:21.616774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:21.617664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.621905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 492/985] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:21.622927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.655408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345175-f878-4403-b344-32d907d24f8e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.655696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345175-f878-4403-b344-32d907d24f8e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.655982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9345175-f878-4403-b344-32d907d24f8e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.657354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 493/986] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:21.663064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.663359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.663642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.680584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:21.681749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:21.729589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca407c5-da10-41d2-be09-213d28a53a46 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:21.747556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 494/987] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:21.766164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:21.766859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.767142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.767416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.768106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:21.768410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:21.769796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:21.770295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.777777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 494/988] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:21.780541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.871478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcb9ff3-2ae3-47f4-baec-fba582d25389 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:21.881066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118900b-2e0b-46c6-9185-3adfe9e8e570 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:21.905087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:21.905973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.906311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.906684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] PATH_INFO: `/v3/services/image` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.907393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:21.908814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:21.921785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:21.921785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:21.921785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:21.921785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:21.922225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:21.922225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:21.922381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:21.923462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:21.924365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:21.925966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:21.928917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 495/989] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:21.929934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:21.935680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 495/990] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:21.936450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:22.026841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdfe04-bd5b-4a3d-8dea-e4b99dbdaabb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:22.033925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a79342-cdb9-4c93-8bbf-b641f6fdf797 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:22.059524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:22.060202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:22.060484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:22.060761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:22.061452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] RBAC: Adding query filter params (name=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:22.061757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:22.063149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:22.069125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 496/991] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:22.074459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:22.079214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:22.079874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:22.080154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:22.080424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:22.081252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] RBAC: Adding query filter params (interface=admin, service_id=f580a2cb080e4f2cbc235848de3b8d3c, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:22.081736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:22.083130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:22.092300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 496/992] 10.222.0.25 () {56 vars in 1249 bytes} [Tue May 17 18:00:21 2022] GET /identity/v3/endpoints?service_id=f580a2cb080e4f2cbc235848de3b8d3c&interface=admin®ion_id=RegionOne => generated 193 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:22.093323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:22.168352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e87b4-5e2f-4feb-8a65-b67c98ec0bb0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:22.185371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c956b2b-4ca7-4338-84df-bca569612993 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:22.200256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:22.200923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:22.201206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:22.201481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:22.202177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] RBAC: Adding query filter params (type=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:22.202482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:22.203886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea0517-4085-4380-b3fc-729898bedd5b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:22.208997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 497/993] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:22 2022] GET /identity/v3/services?type=image => generated 122 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:22.218617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:22.219300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:22.219577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:22.219845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:22.220527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:22.221996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cbe93-3062-4292-9411-716397e08935 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:22.238621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 497/994] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:22 2022] GET /identity/v3/services => generated 1727 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:00:23.379288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afad8f-290c-4395-a512-b4536f97a573 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:23.379853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afad8f-290c-4395-a512-b4536f97a573 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:23.379853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3afad8f-290c-4395-a512-b4536f97a573 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:23.381327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 498/995] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:23.386421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5525-486a-484d-b888-96e12847a054 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:23.386847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5525-486a-484d-b888-96e12847a054 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:23.387026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d5525-486a-484d-b888-96e12847a054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:23.403201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b54d5525-486a-484d-b888-96e12847a054 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:23.404472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b54d5525-486a-484d-b888-96e12847a054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:23.471290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 498/996] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:23.493900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afad8f-290c-4395-a512-b4536f97a573 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:23.594649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3afad8f-290c-4395-a512-b4536f97a573 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:23.628045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:23.628825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:23.629106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:23.629429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:23.630011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:23.631387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:23.643022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:23.644667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:23.645527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:23.646992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 499/997] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:23.650747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5525-486a-484d-b888-96e12847a054 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:23.746202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d5525-486a-484d-b888-96e12847a054 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:23.779832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:23.780507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:23.780791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:23.781066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:23.781761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] RBAC: Adding query filter params (name=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:23.782067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:23.783457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:23.793391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 499/998] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:23.794632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:23.890667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda11f6-b8b9-46e1-a3a9-ccbc8bc431f5 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:23.926216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:23.926934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:23.927221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:23.927560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:23.928269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] RBAC: Adding query filter params (type=compute) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:23.928626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:23.929989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:23.940170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 500/999] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:23 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:23.941218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:24.041621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b785a7-ed39-4333-a1c8-c453f668be48 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:24.074661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:24.075327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.075612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.075891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.076670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] RBAC: Adding query filter params (interface=public, service_id=ac2c61c47f8440408a35827368cb23ad, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:24.076985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:24.078349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5fe1d-3498-4a0f-8abd-759c978be8f8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:24.088076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 500/1000] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:00:23 2022] GET /identity/v3/endpoints?service_id=ac2c61c47f8440408a35827368cb23ad&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:24.089310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:24.185915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31eae16-f158-46be-9561-c1c4831ea187 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:24.218280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:24.218980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.219262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.219535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.220200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:24.221598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97013d9-84e2-4e33-b3bf-7378046a6955 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:24.228305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 501/1001] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:24 2022] GET /identity/v3/services => generated 1727 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:00:24.472551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432971eb-2cf5-457a-ae78-2f6d446dbc72 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.473073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432971eb-2cf5-457a-ae78-2f6d446dbc72 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.473073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432971eb-2cf5-457a-ae78-2f6d446dbc72 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.473237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d20-495c-44ab-9b63-d4ceb9f048b2 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.473580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d20-495c-44ab-9b63-d4ceb9f048b2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.473661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb544d20-495c-44ab-9b63-d4ceb9f048b2 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.474520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 501/1002] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:24.475342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 502/1003] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:24.479393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.479675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.479946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.480288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.480575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.480852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.496751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:24.497908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:24.498724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:24.500051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:24.563120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 502/1004] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:24.571096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 503/1005] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:24.587778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:24.592771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:24.686790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3350a3f-373a-4b57-85de-6c0d81452e87 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:24.688103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cceb4e-2c1d-46a3-85b3-00475970f9c0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:24.721550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:24.722291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:24.722667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.722777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.722958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.723057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.723217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.723489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.723648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:24.724203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:24.725013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:24.725580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:24.738959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:24.740115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 17 18:00:24.741047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:24.741828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 504/1006] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:24 2022] POST /identity/v3/services => generated 242 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:24.743344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 503/1007] 10.222.0.25 () {56 vars in 1126 bytes} [Tue May 17 18:00:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:24.749519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:24.864237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc31af1-1b85-4073-a024-8eb0a6b75e55 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:24.899009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:24.899696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:24.899977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:24.900251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:24.900964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:24.901268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:24.902682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:24.908189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 505/1008] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:24.913740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:25.020245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc1b7b-c989-4180-aeee-b52002ed4feb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:25.052823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:25.053489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:25.053764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:25.054031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:25.054753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:25.055055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:25.056411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943f8af1-2824-4620-a78e-f39c3649156c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:25.061384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 504/1009] 10.222.0.25 () {56 vars in 1122 bytes} [Tue May 17 18:00:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:25.067488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:25.163874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d03c1e-1cf3-407e-a73b-dbe166ee2284 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:25.195691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:25.196350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:25.196634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:25.196911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:25.197647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:25.199042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029c48f-6fa8-40a2-8ecd-8361dd9f6b40 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:25.214102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 506/1010] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:25 2022] POST /identity/v3/endpoints => generated 325 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:26.496937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252c2f-b93d-45f0-9398-a7159c77ec37 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:26.497501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252c2f-b93d-45f0-9398-a7159c77ec37 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:26.497501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2252c2f-b93d-45f0-9398-a7159c77ec37 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:26.498945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 505/1011] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:26.504926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:26.505328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:26.505510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:26.522142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:26.523348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:26.592875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 507/1012] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:26 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:26.615825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252c2f-b93d-45f0-9398-a7159c77ec37 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:26.712076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2252c2f-b93d-45f0-9398-a7159c77ec37 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:26.744081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:26.744879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:26.745166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:26.745445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:26.746092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:26.747538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:26.759682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:26.760687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 17 18:00:26.761623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:26.769049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 506/1013] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:26.769179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:26.867776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a7a88-69bc-48f8-8443-596930a54aac None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:26.899697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:26.900364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:26.900648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:26.900923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:26.901618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] RBAC: Adding query filter params (name=compute) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:26.901921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:26.903308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44694cac-1575-46ab-853b-6f6e81d114ff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:26.908188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 508/1014] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:26.914123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:26.999214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c136-3d49-4fdc-b6c3-297bad9764e1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:26.999513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c136-3d49-4fdc-b6c3-297bad9764e1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:26.999720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8c136-3d49-4fdc-b6c3-297bad9764e1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.001196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 509/1015] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:27.005970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.006257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.006541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.015431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115dde1-817b-4e77-a451-6928669c0e53 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.023496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:27.024652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:27.051589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.052258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.052544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.052822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.053520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:27.053828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.055223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.064944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 507/1016] 10.222.0.25 () {56 vars in 1112 bytes} [Tue May 17 18:00:26 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:27.066444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.090293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 510/1017] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:27 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:27.112917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.165049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db2de6f-d9ab-4ec2-b624-d7ce643ae0bb None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.198229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.198987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.199207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.199485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.200219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.201624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.208628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa4115-4803-4d8b-a7a5-02858eb73c22 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.223544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 508/1018] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:27 2022] POST /identity/v3/endpoints => generated 334 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:27.264772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.265527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.265810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.266081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] PATH_INFO: `/v3/services/image` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.266816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.268299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:27.280944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:27.282066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:27.287737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 511/1019] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:27.291486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.396293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fc78da-68fe-4fd4-a0a7-0eb234ee1d5b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.430865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.431542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.431824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.432096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.432793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] RBAC: Adding query filter params (name=image) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:27.433092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.434449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a16196-702f-48b7-bcc1-87d4a27202bb None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.439667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 509/1020] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:27.446077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.467059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9db42f-5616-4683-af97-438b07ebf0a1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.467374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9db42f-5616-4683-af97-438b07ebf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.467614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9db42f-5616-4683-af97-438b07ebf0a1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.469120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 510/1021] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:27.474402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.474739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.475014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.493786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:27.495389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:27.547542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c62dd5a-a638-4f48-87fa-5172a7ac3c60 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.563900 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 511/1022] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:27.581690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.582359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.582672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.582946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.583630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] RBAC: Adding query filter params (type=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:27.583931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.585280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.587448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.590175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 512/1023] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:27.596026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.686858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847d76c6-9063-439d-8b8e-ae4fe7948d2d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.694678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f330571-4f58-4fb7-b2a9-83baf5648210 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.719821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.720626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.720905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.721174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.722879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.724344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.726163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 512/1024] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:27.728613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.729283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.729569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.729843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.730907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] RBAC: Adding query filter params (interface=public, service_id=977b7e2e7686484794d0293b82a0e45d, region_id=RegionOne) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:27.731033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.731684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.732342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.743218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 513/1025] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/endpoints?service_id=977b7e2e7686484794d0293b82a0e45d&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:27.744569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:27.836744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ecb0f-fe74-4d64-afde-fb5782ae5f78 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.844758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f3451b-799e-482e-8290-0b114c8cdb38 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:27.871196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.872210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.872708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.873077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.874040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.875588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0346d2-1213-40f9-9b60-db10663fbb74 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.879230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:27.879898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:27.880184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:27.880458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:27.881134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:27.882490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9e5df-9835-4aa9-ac32-4204e08d002a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:27.895976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 514/1026] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:00:27 2022] GET /identity/v3/services => generated 1957 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:00:27.917094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 513/1027] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:27 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:29.568692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153a1d-12bd-4316-8843-b63ffedb9735 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:29.569249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153a1d-12bd-4316-8843-b63ffedb9735 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:29.569249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be153a1d-12bd-4316-8843-b63ffedb9735 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:29.570626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 515/1028] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:29.575999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:29.576386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:29.576560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:29.593197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:29.594373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:29.659844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 514/1029] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:29.683396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153a1d-12bd-4316-8843-b63ffedb9735 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:29.781022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be153a1d-12bd-4316-8843-b63ffedb9735 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:29.814144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:29.815033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:29.815965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:29.816238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:29.826187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:29.834535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:29.835541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:29.841403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 516/1030] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:29.842153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:29.940997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f370e5a5-ba2a-4822-b3d7-d34fc5e5d790 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:29.977440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:29.978116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:29.978691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:29.978946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:29.979615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:29.979937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:29.981291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:29.993832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 515/1031] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:29.995228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.102532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4919f1-4ca9-4085-aa2b-a838fc0ccf95 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.147229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.148033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.148311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.148581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.159657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.161339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-245af12f-de9f-488d-8e9a-aec94e9b109d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:30.178986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:30.179963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:30.180914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:30.180914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:30.180914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:30.180914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:30.181872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 517/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:30.185865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.202683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae357e0-4af0-4b08-ba93-e80d6f8e7b09 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.202974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae357e0-4af0-4b08-ba93-e80d6f8e7b09 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.203251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae357e0-4af0-4b08-ba93-e80d6f8e7b09 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.204612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 518/1033] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:30.210359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27112e58-4dc5-43ed-bcc4-7c824db74a80 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.210688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27112e58-4dc5-43ed-bcc4-7c824db74a80 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.211009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27112e58-4dc5-43ed-bcc4-7c824db74a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.227949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-27112e58-4dc5-43ed-bcc4-7c824db74a80 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:30.229117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-27112e58-4dc5-43ed-bcc4-7c824db74a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:30.285816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73fe27e-fecc-4fbd-b5e9-eebc59da87b4 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.292315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 519/1034] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:30.293682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbeca-3693-407a-a0ce-ece46afc8092 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.294033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbeca-3693-407a-a0ce-ece46afc8092 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.294295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eecbeca-3693-407a-a0ce-ece46afc8092 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.295718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 520/1035] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:30.301091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.301372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.301665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.318879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:30.320079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:30.321751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.322415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.322734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.323006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.323709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:30.324011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.325364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.337470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 516/1036] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:30.338251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.383106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 521/1037] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:30.383847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.437205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f97dd-4cb0-439a-acfe-1ce525246e1b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.470279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.471114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.471889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.472173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.473353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.474828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.476443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 517/1038] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:30.477205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.477306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accc623b-b49e-4d8a-9599-2c8719434b77 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.510904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.511805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.512108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.512381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.519862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.521330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:30.535884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:30.536878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 522/1039] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:30.537872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.571831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b524fc-5bbb-4fec-8dec-9f2732167146 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.604013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.604796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.605072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.605338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] PATH_INFO: `/v3/services/image` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.605969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.607347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:30.618536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:30.619578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:30.620543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 518/1040] 10.222.0.25 () {56 vars in 1105 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/services/image => generated 86 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:30.621984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.631291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e11d18-47d5-46a2-9f28-bf8a2e25c636 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.665061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.665661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.665943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.666225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.666963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.668375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.688750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 523/1041] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 18:00:30 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:30.689544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.721969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba9dc4a-9479-44b4-aea2-42e2e798aa78 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.758248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.758969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.759251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.759520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.760357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:30.760653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.762102 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.788667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 519/1042] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:30.790187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.802469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01221a31-15de-4fe6-ad63-98060aed43e6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.846428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.847222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.847508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.847781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.848488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] RBAC: Adding query filter params (name=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:30.848794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:30.850179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:30.860620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 524/1043] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:30.861436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:30.899479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455d84da-4e95-4fdf-b0d9-5feb7fa3b822 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:30.933596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:30.934266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:30.934548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:30.934936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:30.971794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9611f14a-9cde-41b0-9928-6efa0c30f5a8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.003488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.005072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.006272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.006977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.007258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.007528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.008222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] RBAC: Adding query filter params (type=image) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:31.008585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.009923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.015087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 525/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:31.020592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.101477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 520/1045] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:30 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:31.106695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.120926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2304581-167c-43a4-8ebc-eaf728735290 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.155932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.156596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.156875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.157141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.157867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.159376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.178822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 526/1046] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:00:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:31.208144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3896b15c-ecf7-4fca-817e-85c5ea6eb7d7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.254159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.255020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.255297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.255572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.266674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.268204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:31.288274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:31.289330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:31.290304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:31.290304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:31.290304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:31.290304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:31.294438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 521/1047] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:31.295769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.399373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8120e3c-ea1d-40af-b715-341dbe47cb14 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.432267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.432931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.433210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.433478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.434184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:31.434482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.435865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.447881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 527/1048] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:31.453652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.551523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e10325-8b76-464b-97d3-193cd2e8601b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.584350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.585447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.585936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.586386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.593327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.595006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:31.609502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:31.610872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:31.611796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:31.613700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 522/1049] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:31.619111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.716266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c42d78-a707-4800-be99-15aa5cc4b110 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.749787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.750454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.750767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.751044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.751821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:31.752129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.754050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f56be-0b47-4469-84dc-8e57d93d07fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.770672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 528/1050] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:31.772253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:31.869653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39964ab-b4be-48f2-b9d6-4742b2b936e9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:31.902269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:31.903052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:31.903399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:31.903740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:31.904632 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] RBAC: Adding query filter params (role.id=14dbc8b74d6a4c848e971cdc7e1f8712, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:31.905012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:31.906492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6899522c-c148-42f8-9cb0-2a29c4a2e55e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:31.918664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 523/1051] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:31 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=14dbc8b74d6a4c848e971cdc7e1f8712 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:32.971364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6a4f-e9b7-4f63-8d32-d87a29052971 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:32.971981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6a4f-e9b7-4f63-8d32-d87a29052971 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:32.971981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c6a4f-e9b7-4f63-8d32-d87a29052971 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:32.973429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 529/1052] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:32.978700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:32.979112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:32.979302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:32.995471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:32.996639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:33.063791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 524/1053] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:33.086012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6a4f-e9b7-4f63-8d32-d87a29052971 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.183080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c6a4f-e9b7-4f63-8d32-d87a29052971 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.214975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.215761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.216034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.216301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.226370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:33.233860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:33.234813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:33.235711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:33.237813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 530/1054] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:33.241538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.339431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7a176-01c5-4746-8d7d-1c9842dfb3ab None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.371404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.372070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.372348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.372617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.373345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:33.373647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:33.375041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aef683f-57cf-4366-b5b5-beecc16bf70a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:33.387980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 525/1055] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:33.389495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.450292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f3cd-741c-4da9-a72b-18238debef2e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.450488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f3cd-741c-4da9-a72b-18238debef2e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.450831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6f3cd-741c-4da9-a72b-18238debef2e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.452299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 526/1056] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:33.457990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.458278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.458554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.475872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:33.477041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:33.486429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d306f67-85b2-4b96-ac01-6460846eaa51 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.521058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.522212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.522681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.523101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] PATH_INFO: `/v3/users/7b82835b830b465da1b8757e4c2e3381` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.543774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] RBAC: Authorizing `identity:get_user(user_id=7b82835b830b465da1b8757e4c2e3381)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:33.546288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:33.553971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 531/1057] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/users/7b82835b830b465da1b8757e4c2e3381 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:33.554805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.556449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 527/1058] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:33.579408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.651142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bc3f5-0e8e-47d4-b13c-9e2f30cb54fb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.674130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6e920-aed7-4fbd-b895-46716dd9f3d8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.684373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.685029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.685317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.685588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.708436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.709020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.709295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.709566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.751517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:33.753561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:33.773430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:33.774892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:33.854070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 532/1059] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:33.855313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.872657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 528/1060] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:00:33.873663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:33.951660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94cc20e-e7ef-4cc1-9800-2add12b252b0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.974321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cd364f-6432-448a-85c8-cad3224e1ab7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:33.990733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:33.991596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:33.991872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:33.992142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:33.993301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:33.994743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:33.996588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 533/1061] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:34.002303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.011664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.012465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.012744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.013018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.023185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.024636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:34.041962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:34.042979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:34.049014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:34.049014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:34.049014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:34.049014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:34.049014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 529/1062] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:34.050298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.097673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e81a002-c47c-4b88-b20b-757b7d7baf26 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.131875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.132547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.132828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.133102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.133946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cf63c19dac5b42a78c8465233204f775, user.id=7b82835b830b465da1b8757e4c2e3381) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:34.134255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.135711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378027e9-21d5-4b06-8c6f-5b482e0310ae None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.141097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 534/1063] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/role_assignments?user.id=7b82835b830b465da1b8757e4c2e3381&scope.project.id=cf63c19dac5b42a78c8465233204f775&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:34.142294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a938b2-f16d-47d0-b959-66f77da49139 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.142601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a938b2-f16d-47d0-b959-66f77da49139 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.142883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a938b2-f16d-47d0-b959-66f77da49139 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.144421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 535/1064] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:34.147725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e03be6-81b4-490f-a561-03c4dbdb5636 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.152419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.152802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.152995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.169996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:34.171267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:34.186104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.186825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.187109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.187387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.188116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:34.188689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.190765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.214739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 530/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:34.256528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 536/1066] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 17 18:00:34.278968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.390277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f1342-bea3-4d0f-8fd7-528e8e9b6517 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.425132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.425952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.426228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.426495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.437402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:34.446507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:34.447528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:34.448545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:34.449593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 531/1067] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:34.455909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.556370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9362-1490-4a79-bbc3-11b527cf1f61 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.589030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.589688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.589971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.590244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.591009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:34.591312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.592658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.600406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 537/1068] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:34.606367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.701383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c768e8ed-fb38-4762-b20b-25f629dfcc13 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.732945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.733729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.734009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.734281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.744804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.746244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:34.763443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:34.764515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:34.770126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:34.770126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:34.770126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:34.770126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:34.770126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 532/1069] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:34.771765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:34.866875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69316a-8b13-4803-b820-cfa4e1564c99 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:34.899193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:34.899857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:34.900136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:34.900408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:34.901117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:34.901422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:34.902804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:34.914660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 538/1070] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:34.920222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.015087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92016-763f-47b1-a18e-65739c48a74b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.046643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.047421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.047699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.047969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.055055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.056472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:35.070254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:35.071403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:35.072518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:35.074857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 533/1071] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 18:00:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:35.077040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.169895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b107df-0ff1-49c7-831b-289b6c649222 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.201736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.202399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.202701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.202975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.203796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:35.204101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.205562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.223092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 539/1072] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 18:00:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:35.228655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.325265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a796c64-4e02-463e-8f0d-d9c597870a36 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.357419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.358214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.358497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.358792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.369151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.370606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:35.387381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:35.388472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:35.389416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:35.389416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:35.389416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:35.389416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:35.389416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 534/1073] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:35.394927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.487487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbe6b12-ca09-47ef-8a25-f2164c6a2d92 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.518855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.519511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.519788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.520054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.520756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:35.521053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.522391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.533023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 540/1074] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:35.539046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.633330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f988ab87-cf6f-45ca-8728-cab0bfcd3c74 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.665553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.666344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.666654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.666931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.673323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.674841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:35.689862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:35.691191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:35.692326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 535/1075] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:35.698795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.793416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce5684-47cc-49ef-8dba-0a457e3db1ed None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.824967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.825624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.825916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.826178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.826978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:35.827286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.828693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a5e64-15d6-481e-8b5b-aed3fb270ae1 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.840947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 541/1076] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:35.847439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:35.941905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba862d6-9646-44d5-aa9e-b0b9f74aed97 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:35.974131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:35.975042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:35.975320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:35.975593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/14dbc8b74d6a4c848e971cdc7e1f8712` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:35.977763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=1bc19fa7285245d8bdb984da94d502b8, role_id=14dbc8b74d6a4c848e971cdc7e1f8712)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:35.979267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bd19b-bd53-4ca6-98fc-f9a03ecdf60b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:35.992930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 536/1077] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:00:35 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/1bc19fa7285245d8bdb984da94d502b8/roles/14dbc8b74d6a4c848e971cdc7e1f8712 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:00:36.358637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8653d-56df-4be4-a08e-8dda92ab119a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:36.359206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8653d-56df-4be4-a08e-8dda92ab119a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:36.359206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8653d-56df-4be4-a08e-8dda92ab119a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:36.360562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 542/1078] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:36.366961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:36.367365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:36.367599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:36.384591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:36.385754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:36.448599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 537/1079] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:36.470457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8653d-56df-4be4-a08e-8dda92ab119a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:36.568442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd8653d-56df-4be4-a08e-8dda92ab119a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:36.601384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:36.602177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:36.602459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:36.602762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:36.613121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:36.620696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:36.621840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:36.622824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 543/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:00:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:36.627832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:36.719642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c117be-85e6-48e2-a35a-bbabcecb0a1e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:36.752551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:36.753208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:36.753490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:36.753766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:36.754498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:36.754830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:36.756204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:36.764183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 538/1081] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:36.770018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:36.864399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409837b-236c-42aa-b9f6-e25ab0daa8ca None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:36.894596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:36.895453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:36.895730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:36.896000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] PATH_INFO: `/v3/users/7b82835b830b465da1b8757e4c2e3381` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:36.897150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] RBAC: Authorizing `identity:get_user(user_id=7b82835b830b465da1b8757e4c2e3381)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:36.898561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:36.900182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 544/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:36 2022] GET /identity/v3/users/7b82835b830b465da1b8757e4c2e3381 => generated 285 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:36.905720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:37.004060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2afc2-820e-4a9a-9785-0f7721f1f293 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:37.035803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:37.036655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:37.036932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:37.037201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:37.038355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:37.039808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb229754-a656-4a58-b990-79e0e6345b70 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:37.041487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 539/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:36 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:37.047203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:37.143373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a1260-00ad-419f-a2a4-c50ef42e0a4e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:37.175201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:37.176087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:37.176365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:37.176632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775/users/7b82835b830b465da1b8757e4c2e3381/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:37.178556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf63c19dac5b42a78c8465233204f775, user_id=7b82835b830b465da1b8757e4c2e3381, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:37.179996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25937a-d43f-4aca-9b31-acc7a855e045 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:37.195403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 545/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:00:37 2022] PUT /identity/v3/projects/cf63c19dac5b42a78c8465233204f775/users/7b82835b830b465da1b8757e4c2e3381/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:00:38.200542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8540-63c4-4da5-ab74-e48e129a3b40 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.201094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8540-63c4-4da5-ab74-e48e129a3b40 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.201094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd8540-63c4-4da5-ab74-e48e129a3b40 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.202490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 540/1085] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:38.208625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.209060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.209169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.226065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:38.227251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:38.291410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 546/1086] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:38.315494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd8540-63c4-4da5-ab74-e48e129a3b40 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:38.411417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd8540-63c4-4da5-ab74-e48e129a3b40 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:38.443124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:38.443931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.444211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.444486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.454473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:38.463130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:38.464110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:38.465047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 541/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Tue May 17 18:00:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:38.470388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:38.562628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d300fe03-ad7a-441c-b9c1-141008636f8a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:38.594190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:38.594877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.595157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.595424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.596701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:38.596998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:38.598344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:38.605779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 547/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:00:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:38.611321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:38.706129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe75502-0b52-40d9-831e-9aa9223dc8c3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:38.738199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:38.739019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.739297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.739591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.749113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:38.750538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:38.767638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:38.769195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:38.770192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:38.770192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:38.770192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:38.770192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:38.770192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 542/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:38.775516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:38.869278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d10ae-718f-42db-8d22-c080c3c1323d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:38.901193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:38.901852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:38.902129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:38.902401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:38.903140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:38.903441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:38.904789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:38.915964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 548/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:38.921512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.017190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46afe6d2-ad7b-4f5d-8108-52246d2e4931 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.049739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.050525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.050831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.051107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.057805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.059261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:00:39.073580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:39.074595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:39.075670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 543/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Tue May 17 18:00:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:00:39.080396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.173047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87703c1-8e9e-48d0-802c-fd1894c26370 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.208634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.209348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.209584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.209854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.210717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:39.211053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.212488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257c0b3a-c652-4f8a-b72f-c86013c84286 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.230172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 549/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:39.235892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.331245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274670ae-b13d-41da-82b8-e2650e785f9b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.364113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.364761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.365046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.365320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.371572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b22bf-5f35-4a13-91be-3f5e2719ebcc None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.371857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b22bf-5f35-4a13-91be-3f5e2719ebcc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.372127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7b22bf-5f35-4a13-91be-3f5e2719ebcc None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.373494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 550/1093] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:00:39.378271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.378555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.378923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.394908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:39.396064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:39.429799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.431280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.457957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 551/1094] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:39.480761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.524531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 544/1095] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:39.530171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.573786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c487c2-c3ae-46e8-b26e-f670c6731f08 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.605481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.606206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.606481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.606783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.616984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:00:39.622584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7e880-6e21-48c9-ba45-e8f4622a36e6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:00:39.624614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:39.625721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:00:39.626662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 552/1096] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:39.631775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.655907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.656695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.656973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.657240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.667197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.668626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:00:39.685288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:39.686280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:39.687259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:00:39.687259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:00:39.687259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:00:39.687259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:39.687259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 545/1097] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:39.692847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.730220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4893d-e873-4969-88e0-8c21471491bc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.761467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.762118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.762393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.762698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.763429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:39.763728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.765075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.778419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 553/1098] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:39.779387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.784358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97118ae3-49ba-468b-943f-3d5757fc5710 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.816601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.817253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.817545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.817813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.818513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:39.818840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.820186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.831221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 546/1099] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:39.836702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.874882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a7e116-2543-4d1d-ba19-9bb323a511cf None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.906844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.907708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.907984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.908255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] PATH_INFO: `/v3/users/7b82835b830b465da1b8757e4c2e3381` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.909559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] RBAC: Authorizing `identity:get_user(user_id=7b82835b830b465da1b8757e4c2e3381)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.911020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.912639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 554/1100] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/users/7b82835b830b465da1b8757e4c2e3381 => generated 285 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:39.918258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:39.930277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244560f9-ed24-445e-a204-2a50bbbf3646 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:39.962861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:39.963639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:39.963921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:39.964195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:39.970670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:39.972172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:00:39.986247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:00:39.987752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:00:39.988687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 547/1101] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:00:39.993594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:40.017711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b677bd-507c-4632-b2e7-204f3fef08ee None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:40.049899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:40.050550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:40.050862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:40.051137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:40.088203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81747102-18d8-43e4-a335-08bdabdb4509 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:40.115982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:40.117417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:40.120135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:40.120781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:40.121059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:40.121328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:40.122098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:40.122402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:40.123854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:40.134844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 548/1102] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:40.140588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:40.222302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 555/1103] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:00:40.228174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:40.236351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e56f198-8dc1-46f8-85ad-b5d0d84d4979 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:40.267501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:40.268868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:40.269155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:40.269421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:40.270231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] RBAC: Adding query filter params (role.id=14dbc8b74d6a4c848e971cdc7e1f8712, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=1bc19fa7285245d8bdb984da94d502b8) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:40.270536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:40.271981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:40.277484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 549/1104] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:40 2022] GET /identity/v3/role_assignments?user.id=1bc19fa7285245d8bdb984da94d502b8&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=14dbc8b74d6a4c848e971cdc7e1f8712 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:00:40.323369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6b83a-5ea2-46e1-9772-40eeb3891d95 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:40.359835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:40.360711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:40.360986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:40.361254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:40.362633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:40.364075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b79745-1266-42d3-9964-73c25953c96c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:40.365840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 556/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:40 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:40.372185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:40.474564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cdd41d-1783-4a9b-ad4f-207e6a1ca7ee None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:40.508339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:40.508990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:40.509270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:40.509540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:40.510349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cf63c19dac5b42a78c8465233204f775, user.id=7b82835b830b465da1b8757e4c2e3381) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:40.510694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:40.512108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7d715-8575-4e2b-8abf-43bd2f12951e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:40.518598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 550/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:40 2022] GET /identity/v3/role_assignments?user.id=7b82835b830b465da1b8757e4c2e3381&scope.project.id=cf63c19dac5b42a78c8465233204f775&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:42.781305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266efe-676e-4be2-b9aa-c64beccc2622 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:42.781909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266efe-676e-4be2-b9aa-c64beccc2622 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:42.781909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f266efe-676e-4be2-b9aa-c64beccc2622 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:42.783248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 557/1107] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:42.789038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:42.789468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:42.789569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:42.806307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:42.807511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:42.869949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 551/1108] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:42.894305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f266efe-676e-4be2-b9aa-c64beccc2622 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:42.990446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f266efe-676e-4be2-b9aa-c64beccc2622 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:43.022158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:43.022959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:43.023237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:43.023507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:43.024650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:43.026062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1285bc17-f02a-4be5-8467-c0dde56cae29 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:43.027676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 558/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:43.034041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:43.124299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499728d6-40c6-44f5-92ee-ad3ee020794e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:43.155467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:43.156119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:43.156397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:43.156670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:43.157354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:43.159470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9198a350-b7f7-422c-9cc7-25dd5b822504 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:43.178521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 552/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 18:00:43 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:45.477939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833d657-f4fa-4e37-b841-4c79d329816e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:45.478521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833d657-f4fa-4e37-b841-4c79d329816e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:45.478521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833d657-f4fa-4e37-b841-4c79d329816e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:45.479925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 559/1111] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:45.485473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:45.485939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:45.486048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:45.506964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:45.508162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:45.577429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 553/1112] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:45.601515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833d657-f4fa-4e37-b841-4c79d329816e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:45.697334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833d657-f4fa-4e37-b841-4c79d329816e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:45.729273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:45.730060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:45.730350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:45.730648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] PATH_INFO: `/v3/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:45.732109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] RBAC: Authorizing `identity:get_role(role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:45.733466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:45.734869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 560/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:45 2022] GET /identity/v3/roles/6aada032643443b8a7ee169eadfab258 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:45.741457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:45.834798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858a116-32e1-463f-a4de-e034750b4d35 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:45.867744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:45.868613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:45.868895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:45.869170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] PATH_INFO: `/v3/users/b290b3de047e45e88b3718660710655f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:45.881656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=b290b3de047e45e88b3718660710655f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:45.883132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:45.884770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 554/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:45 2022] GET /identity/v3/users/b290b3de047e45e88b3718660710655f => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:45.890557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:45.988369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c8546-2bb5-427c-b661-604cd30d9cde None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:46.020312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:46.020955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:46.021305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:46.021580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:46.084553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:46.085968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:46.181201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 561/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:46.187195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:46.279622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78804d6c-306f-48ca-ac59-2c4d49ca9ae9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:46.310956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:46.311798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:46.312074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:46.312346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:46.313754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:46.315222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b017a5-46eb-4358-a49a-cdb8e1c6ead2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:46.316872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 555/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:46 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:46.322995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:46.416444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d7f88-5b8a-456c-bd02-24db1de5aa27 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:46.448437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:46.449074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:46.449355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:46.449627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:46.450430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=cf63c19dac5b42a78c8465233204f775, user.id=b290b3de047e45e88b3718660710655f) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:46.450764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:46.452170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7a3c-7f67-439d-bbbe-c408cb5f9e7d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:46.457895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 562/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:46 2022] GET /identity/v3/role_assignments?user.id=b290b3de047e45e88b3718660710655f&scope.project.id=cf63c19dac5b42a78c8465233204f775&role.id=6aada032643443b8a7ee169eadfab258 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:48.616034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a676f2-06b8-4fe0-9c37-b8370f8e89a8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:48.616604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a676f2-06b8-4fe0-9c37-b8370f8e89a8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:48.616604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a676f2-06b8-4fe0-9c37-b8370f8e89a8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:48.617939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 556/1118] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:48.623039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:48.623416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:48.623592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:48.640793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:48.641940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:48.703439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 563/1119] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:48.725814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a676f2-06b8-4fe0-9c37-b8370f8e89a8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:48.820524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a676f2-06b8-4fe0-9c37-b8370f8e89a8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:48.851756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:48.852588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:48.852864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:48.853133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] PATH_INFO: `/v3/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:48.854598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] RBAC: Authorizing `identity:get_role(role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:48.855951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:48.857278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 557/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:48 2022] GET /identity/v3/roles/6aada032643443b8a7ee169eadfab258 => generated 223 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:48.863274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:48.958157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711d2ea-cad1-4576-93eb-9c3852d8084d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:48.990564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:48.991470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:48.991750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:48.992021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] PATH_INFO: `/v3/users/b290b3de047e45e88b3718660710655f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:48.993181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] RBAC: Authorizing `identity:get_user(user_id=b290b3de047e45e88b3718660710655f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:48.994611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:48.996223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 564/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:48 2022] GET /identity/v3/users/b290b3de047e45e88b3718660710655f => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:49.002509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:49.094752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868be8b-0d7a-4b81-9faf-f328e09a87d9 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:49.126702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:49.128193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:49.128472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:49.128747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:49.129924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:49.131366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa89dc0-4ad1-4e44-bd34-b3e93cb7049a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:49.133035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 558/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:49 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:49.138745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:49.230135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac353bc-f5f0-4628-928a-456209c1dfd8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:49.262096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:49.262995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:49.263276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:49.263548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775/users/b290b3de047e45e88b3718660710655f/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:49.265702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf63c19dac5b42a78c8465233204f775, user_id=b290b3de047e45e88b3718660710655f, role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:49.267139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75291256-3371-421b-b3e4-f0cbe62f0a63 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:49.279214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 565/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:00:49 2022] PUT /identity/v3/projects/cf63c19dac5b42a78c8465233204f775/users/b290b3de047e45e88b3718660710655f/roles/6aada032643443b8a7ee169eadfab258 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:00:51.445269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53424b-ce4a-4d2a-8bcb-5b681a33dd3f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:51.445829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53424b-ce4a-4d2a-8bcb-5b681a33dd3f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:51.445829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53424b-ce4a-4d2a-8bcb-5b681a33dd3f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:51.447198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 559/1124] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:51.452304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:51.452742 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:51.452843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:51.469647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:51.471656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:51.532879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 566/1125] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:51.556386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53424b-ce4a-4d2a-8bcb-5b681a33dd3f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:51.650270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53424b-ce4a-4d2a-8bcb-5b681a33dd3f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:51.681276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:51.682110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:51.682388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:51.682683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] PATH_INFO: `/v3/roles/6aada032643443b8a7ee169eadfab258` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:51.684125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] RBAC: Authorizing `identity:get_role(role_id=6aada032643443b8a7ee169eadfab258)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:51.685471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:51.686827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 560/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:51 2022] GET /identity/v3/roles/6aada032643443b8a7ee169eadfab258 => generated 223 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:51.693350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:51.785051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cafbf7-9eb5-4e28-8e63-b827b253cc64 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:51.816795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:51.817639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:51.817914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:51.818179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] PATH_INFO: `/v3/users/b290b3de047e45e88b3718660710655f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:51.819351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] RBAC: Authorizing `identity:get_user(user_id=b290b3de047e45e88b3718660710655f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:51.820754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:51.822337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 567/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:00:51 2022] GET /identity/v3/users/b290b3de047e45e88b3718660710655f => generated 286 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:51.827819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:51.919537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718797ae-fa6c-49bd-8289-b5b0322c3667 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:51.952085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:51.952729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:51.953011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:51.953286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:52.018125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:52.019585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:52.109737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 561/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:00:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:00:52.116771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:52.209802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f1db0-6749-4c64-9d92-e90e2b80cbed None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:52.241177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:52.242011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:52.242291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:52.242563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] PATH_INFO: `/v3/projects/cf63c19dac5b42a78c8465233204f775` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:52.243741 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] RBAC: Authorizing `identity:get_project(project_id=cf63c19dac5b42a78c8465233204f775)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:52.245149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef994d2c-4361-4f50-ae3a-cb4958febdd9 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:52.246841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 568/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:00:52 2022] GET /identity/v3/projects/cf63c19dac5b42a78c8465233204f775 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:52.253572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:52.351539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177da1ef-e8a6-40dc-afd9-d93ff5f127aa None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:52.383960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:52.384536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:52.384812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:52.385081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:52.385889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] RBAC: Adding query filter params (role.id=6aada032643443b8a7ee169eadfab258, scope.project.id=cf63c19dac5b42a78c8465233204f775, user.id=b290b3de047e45e88b3718660710655f) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:00:52.386193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:52.387644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5c999-357c-407a-8fd6-4482e1d363fc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:52.393186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 562/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:00:52 2022] GET /identity/v3/role_assignments?user.id=b290b3de047e45e88b3718660710655f&scope.project.id=cf63c19dac5b42a78c8465233204f775&role.id=6aada032643443b8a7ee169eadfab258 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:54.606050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9590-7233-442b-ab59-862a34d25068 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:54.606639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9590-7233-442b-ab59-862a34d25068 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:54.606639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70da9590-7233-442b-ab59-862a34d25068 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:54.607979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 569/1131] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:54.613266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:54.613675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:54.613825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:54.630286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:54.631478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:54.693417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 563/1132] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:54.716831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9590-7233-442b-ab59-862a34d25068 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:54.810004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70da9590-7233-442b-ab59-862a34d25068 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:54.842107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:54.842899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:54.843175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:54.843444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:54.844582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:54.846211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de8a14f-43c1-45b7-ad14-73f509b16580 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:54.847808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 570/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:54.853375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:54.945515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de7c63f-db65-4d71-8ca5-cb88e6810b29 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:54.977674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:54.978336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:54.978645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:54.978917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:54.979620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:54.981039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149bc231-22ad-4124-91c4-e3c38651ec38 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:55.006415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 564/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:00:54 2022] POST /identity/v3/projects => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:00:57.242430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163121-9f08-4b1d-8a22-5727bc23d967 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:57.242990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163121-9f08-4b1d-8a22-5727bc23d967 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:57.242990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68163121-9f08-4b1d-8a22-5727bc23d967 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:57.244360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 571/1135] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:57.249826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:57.250199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:57.250390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:57.266453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:57.268161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:57.330787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 565/1136] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:00:57.355286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68163121-9f08-4b1d-8a22-5727bc23d967 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:57.449341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68163121-9f08-4b1d-8a22-5727bc23d967 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:57.481713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:57.482484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:57.482786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:57.483056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] PATH_INFO: `/v3/domains/default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:57.484331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:57.485734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b6ab6d-dd78-44c7-83f8-b7f67e4d1257 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:57.487498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 572/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:00:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:00:57.493099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:00:57.584671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b23790-d0be-4e7f-9a45-c470fc8c1a4d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:00:57.616294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:00:57.616955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:57.617237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:57.617513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:57.618220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:00:57.619664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0b9d67-6b3d-48e0-8baa-7ba6a7428322 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:00:57.638978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 566/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 18:00:57 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:00:59.896789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088660-92cf-4589-aff8-e3d53a9d4144 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:59.897356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088660-92cf-4589-aff8-e3d53a9d4144 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:59.897356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97088660-92cf-4589-aff8-e3d53a9d4144 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:59.898714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 573/1139] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:00:59.904000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:00:59.904432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:00:59.904538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:00:59.921263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:00:59.922449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:00:59.986710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 567/1140] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:00:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:00.009699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088660-92cf-4589-aff8-e3d53a9d4144 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.103794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97088660-92cf-4589-aff8-e3d53a9d4144 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.135259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.136035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.136312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.136579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.145953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:00.153630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:00.154885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:00.156072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 574/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:00.161234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.252606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6758cb-cae9-4ac1-a4de-75a8490e7386 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.285577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.286235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.286516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.286817 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.287547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:00.287856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:00.289219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:00.296802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 568/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:00.302514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.396142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d6cf8-6e02-4764-a815-0242d765fbad None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.427217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.428020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.428299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.428571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] PATH_INFO: `/v3/users/613dc24fe56b44b892688b9ebf137792` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.441305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] RBAC: Authorizing `identity:get_user(user_id=613dc24fe56b44b892688b9ebf137792)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:00.442762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:00.444383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 575/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/users/613dc24fe56b44b892688b9ebf137792 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:00.450076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.543338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccf3f2-4eee-4d11-abbe-82d6cf608250 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.574055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.574718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.574996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.575265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.637485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:00.638932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:00.728752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 569/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 17 18:01:00.734584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.827733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d13f1d-2aa5-481e-8d34-318d44604ce0 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.859386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.860228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.860507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.860812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] PATH_INFO: `/v3/projects/fddd21da40e34d4ab5fae4164a1a893e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.862114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] RBAC: Authorizing `identity:get_project(project_id=fddd21da40e34d4ab5fae4164a1a893e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:00.863565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4938da-d88a-4cc2-8a7f-38ac27a84c5c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:00.865230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 576/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/projects/fddd21da40e34d4ab5fae4164a1a893e => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:00.871235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:00.964462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c52cc-f10f-451a-a7b6-852f688a9853 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:00.996472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:00.997056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:00.997344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:00.997619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:00.998438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=fddd21da40e34d4ab5fae4164a1a893e, user.id=613dc24fe56b44b892688b9ebf137792) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:00.998778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:01.000202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b24ff1-7773-4a0b-9756-99c9450bce0a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:01.006002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 570/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:01:00 2022] GET /identity/v3/role_assignments?user.id=613dc24fe56b44b892688b9ebf137792&scope.project.id=fddd21da40e34d4ab5fae4164a1a893e&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:01:03.162089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b040bc-5689-46c0-b596-dd42d88a66d7 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.162658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b040bc-5689-46c0-b596-dd42d88a66d7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.162658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b040bc-5689-46c0-b596-dd42d88a66d7 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.163999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 577/1147] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:03.169233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.169639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.169781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.186462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:03.187662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:03.249667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 571/1148] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:03.272279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b040bc-5689-46c0-b596-dd42d88a66d7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:03.365782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b040bc-5689-46c0-b596-dd42d88a66d7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:03.397580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:03.398349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.398652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.398923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.408888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:03.416400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:03.417518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:03.418435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 578/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:03.423399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:03.515038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0ccb0-0a90-4bfb-bb2d-495ef17dc00d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:03.547390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:03.548042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.548521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.548809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.549539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:03.549844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:03.551232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:03.558804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 572/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:03.564939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:03.658418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7257f7b3-970b-4421-b03f-879676b807f8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:03.689759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:03.690635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.690917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.691186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] PATH_INFO: `/v3/users/613dc24fe56b44b892688b9ebf137792` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.692347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] RBAC: Authorizing `identity:get_user(user_id=613dc24fe56b44b892688b9ebf137792)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:03.693758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:03.695385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 579/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:03 2022] GET /identity/v3/users/613dc24fe56b44b892688b9ebf137792 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:03.700880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:03.794855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1eef07-1542-43af-84a1-471a616cec04 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:03.826812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:03.827655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.827938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.828209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] PATH_INFO: `/v3/projects/fddd21da40e34d4ab5fae4164a1a893e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.829458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] RBAC: Authorizing `identity:get_project(project_id=fddd21da40e34d4ab5fae4164a1a893e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:03.831664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a2c61-e858-47ca-b407-a88bf34ac44e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:03.833652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 573/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:03 2022] GET /identity/v3/projects/fddd21da40e34d4ab5fae4164a1a893e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:03.839241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:03.931727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a0156-8fa4-4422-af86-a01df7e72cb6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:03.963906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:03.964790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:03.965072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:03.965344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] PATH_INFO: `/v3/projects/fddd21da40e34d4ab5fae4164a1a893e/users/613dc24fe56b44b892688b9ebf137792/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:03.967287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] RBAC: Authorizing `identity:create_grant(project_id=fddd21da40e34d4ab5fae4164a1a893e, user_id=613dc24fe56b44b892688b9ebf137792, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:03.968699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533aba5-6ad9-4d76-9c4d-0e95469cda06 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:03.981337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 580/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:01:03 2022] PUT /identity/v3/projects/fddd21da40e34d4ab5fae4164a1a893e/users/613dc24fe56b44b892688b9ebf137792/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:01:06.150367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724d8-d4c9-4c92-a22b-f030df42eaf5 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.150931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724d8-d4c9-4c92-a22b-f030df42eaf5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.151066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b724d8-d4c9-4c92-a22b-f030df42eaf5 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.152314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 574/1154] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:06.158005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.158452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.158649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.175446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:06.176552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:06.239558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 581/1155] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:06.262433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b724d8-d4c9-4c92-a22b-f030df42eaf5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:06.356777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b724d8-d4c9-4c92-a22b-f030df42eaf5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:06.388604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:06.389389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.389670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.389939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.400545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:06.408788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:06.409923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:01:06.410933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 575/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:01:06.415934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:06.507161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5708b-6c28-4ae4-9daa-d48219923080 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:06.538996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326175-592b-411f-a717-8efa31183dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:06.539648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326175-592b-411f-a717-8efa31183dba None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.539930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326175-592b-411f-a717-8efa31183dba None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.540205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5326175-592b-411f-a717-8efa31183dba None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.540931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326175-592b-411f-a717-8efa31183dba None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:06.541234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326175-592b-411f-a717-8efa31183dba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:06.542602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5326175-592b-411f-a717-8efa31183dba None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:06.550286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 582/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:06.555889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:06.649444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56a44af-3df4-42dc-ba35-e324e3d4ffc6 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:06.680385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:06.681225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.681507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.681780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] PATH_INFO: `/v3/users/613dc24fe56b44b892688b9ebf137792` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.682965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] RBAC: Authorizing `identity:get_user(user_id=613dc24fe56b44b892688b9ebf137792)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:06.684384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:06.686047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 576/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:06 2022] GET /identity/v3/users/613dc24fe56b44b892688b9ebf137792 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:06.692463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326175-592b-411f-a717-8efa31183dba None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:06.785947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5326175-592b-411f-a717-8efa31183dba None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:06.817149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:06.817773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:06.818055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:06.818328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:06.880191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:06.881592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:06.974876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:01:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:01:06.980743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:07.075776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85078da7-b0ae-41b6-a518-4b43a57e2777 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:07.109142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:07.109989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:07.110272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:07.110977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] PATH_INFO: `/v3/projects/fddd21da40e34d4ab5fae4164a1a893e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:07.112171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] RBAC: Authorizing `identity:get_project(project_id=fddd21da40e34d4ab5fae4164a1a893e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:07.113601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410fcc1f-e469-4787-a33c-9a3f252442bc None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:07.115301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 577/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:06 2022] GET /identity/v3/projects/fddd21da40e34d4ab5fae4164a1a893e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:07.121144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:07.213098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262c5d-f20b-4196-8290-a61ac07cf11b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:07.244577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:07.245210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:07.245487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:07.245758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:07.246566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=fddd21da40e34d4ab5fae4164a1a893e, user.id=613dc24fe56b44b892688b9ebf137792) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:07.246903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:07.248372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f5244-af9b-4065-83b2-00619fe30f16 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:07.253988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 584/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:01:07 2022] GET /identity/v3/role_assignments?user.id=613dc24fe56b44b892688b9ebf137792&scope.project.id=fddd21da40e34d4ab5fae4164a1a893e&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:09.463245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f4d9-4faa-48f6-9e83-9e0ee8fa79f0 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:09.463800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f4d9-4faa-48f6-9e83-9e0ee8fa79f0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:09.463800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f4d9-4faa-48f6-9e83-9e0ee8fa79f0 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:09.465163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 578/1162] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:09.471183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:09.471584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:09.471726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:09.487688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:09.488833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:09.550044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 585/1163] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:09.571874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f4d9-4faa-48f6-9e83-9e0ee8fa79f0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:09.666952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f4d9-4faa-48f6-9e83-9e0ee8fa79f0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:09.698447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:09.699104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:09.699385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:09.699658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:09.761303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:09.762702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:09.854413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 579/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:01:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:01:09.860482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:09.952505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba06921-2134-474b-8340-fc4be7b80a73 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:09.984573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:09.985886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:09.986170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:09.986445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:09.992884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:09.994306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-4b683351-4e63-4582-8dc0-c0e244f4037d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:10.008565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:10.009797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:10.010953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 586/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:01:09 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:10.015808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:10.107041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d786e-e637-40cf-98ab-edf990c83265 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:10.139361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:10.140005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:10.140285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:10.140557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:10.141257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:10.141564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:10.143128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aef1830-ec44-4ba1-98c0-7aabe54366c9 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:10.150030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 580/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue May 17 18:01:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:12.329774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293915c9-edcf-4047-be0e-4d9cdc8a784e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:12.330311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293915c9-edcf-4047-be0e-4d9cdc8a784e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:12.330311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293915c9-edcf-4047-be0e-4d9cdc8a784e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:12.331730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 587/1167] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:12.337005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a03d3-1cfc-4bdd-89c1-5f6de10f0f0f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:12.337405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a03d3-1cfc-4bdd-89c1-5f6de10f0f0f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:12.337559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600a03d3-1cfc-4bdd-89c1-5f6de10f0f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:12.353697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-600a03d3-1cfc-4bdd-89c1-5f6de10f0f0f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:12.354884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-600a03d3-1cfc-4bdd-89c1-5f6de10f0f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:12.428857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 581/1168] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:12.451679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293915c9-edcf-4047-be0e-4d9cdc8a784e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:12.546054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293915c9-edcf-4047-be0e-4d9cdc8a784e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:12.578064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:12.578732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:12.579042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:12.579352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:12.580307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:12.581610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ba5f8-101a-488b-94eb-cba993fbffb7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:12.596088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 588/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue May 17 18:01:12 2022] POST /identity/v3/domains => generated 267 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:01:14.827945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ad9b-63de-4639-a84e-b0ea27ca3a2c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:14.828539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ad9b-63de-4639-a84e-b0ea27ca3a2c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:14.828539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3ad9b-63de-4639-a84e-b0ea27ca3a2c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:14.829957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 582/1170] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:14.835287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:14.835689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:14.835839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:14.852537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:14.853692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:14.916578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 589/1171] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:14.940247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3ad9b-63de-4639-a84e-b0ea27ca3a2c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:15.036589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3ad9b-63de-4639-a84e-b0ea27ca3a2c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:15.068479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:15.069337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:15.069621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:15.069898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] PATH_INFO: `/v3/domains/5c97e5f5cec0475ba4c4225723f5a366` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:15.079866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c97e5f5cec0475ba4c4225723f5a366)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:15.081244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc35e5-8417-47d3-96bf-80447bea02d6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:15.082909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 583/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue May 17 18:01:14 2022] GET /identity/v3/domains/5c97e5f5cec0475ba4c4225723f5a366 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:15.088628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:15.181088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bafed0-d0fd-4a6a-aaac-c6fad6c690cd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:15.212633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:15.213278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:15.213559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:15.213829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:15.214515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:15.215940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1c1ab-8d24-4976-9a8b-c842a6c67fcd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:15.240414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 590/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:01:15 2022] POST /identity/v3/projects => generated 361 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:01:17.490792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d251e-6913-4cfb-ae9e-a5d40f0b876a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:17.491357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d251e-6913-4cfb-ae9e-a5d40f0b876a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:17.491357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d251e-6913-4cfb-ae9e-a5d40f0b876a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:17.492700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 584/1174] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:17.498023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:17.498415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:17.498608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:17.515708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:17.517184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:17.584181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 591/1175] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:17.609401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d251e-6913-4cfb-ae9e-a5d40f0b876a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:17.705502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d251e-6913-4cfb-ae9e-a5d40f0b876a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:17.736608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:17.737443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:17.737719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:17.737990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] PATH_INFO: `/v3/domains/5c97e5f5cec0475ba4c4225723f5a366` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:17.739163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5c97e5f5cec0475ba4c4225723f5a366)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:17.740581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09233623-b027-4e30-b64d-eb41084b62f5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:17.742206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 585/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue May 17 18:01:17 2022] GET /identity/v3/domains/5c97e5f5cec0475ba4c4225723f5a366 => generated 267 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:17.747893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:17.840049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9249e0-07f7-4a3e-b4fc-3d4f1dcbc422 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:17.872281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:17.872939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:17.873219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:17.873492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:17.874195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:17.875722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a2dc3-d536-44d3-a2fc-a528a62052f0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:17.894632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 592/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 18:01:17 2022] POST /identity/v3/users => generated 311 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:01:20.116131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42970-ca4d-42dc-9f92-95e3082b4c98 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.116690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42970-ca4d-42dc-9f92-95e3082b4c98 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.116690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd42970-ca4d-42dc-9f92-95e3082b4c98 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.118018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 586/1178] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:20.123465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.123881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.124028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.140695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:20.142473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:20.204347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 593/1179] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:20.227424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42970-ca4d-42dc-9f92-95e3082b4c98 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:20.321466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd42970-ca4d-42dc-9f92-95e3082b4c98 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:20.352453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:20.353223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.353502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.353770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.364240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:20.371765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:20.372977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:01:20.373962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 587/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:20.379944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:20.473123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674c86c-e1f6-499b-90e3-e715e60e1fc9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:20.505607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:20.506266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.506550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.506852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.507583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:20.507883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:20.509233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:20.516996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 594/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:20.522664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:20.617856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44848-71d7-4703-9ae4-c344788fd981 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:20.651163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:20.652024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.652308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.652585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] PATH_INFO: `/v3/users/1ee1141d959c495d85bb8a18da044886` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.665269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] RBAC: Authorizing `identity:get_user(user_id=1ee1141d959c495d85bb8a18da044886)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:20.666755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:20.668393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 588/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:20 2022] GET /identity/v3/users/1ee1141d959c495d85bb8a18da044886 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:20.674564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:20.768373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29305a-738d-4cb0-9276-a83a0e709897 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:20.800217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:20.800862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:20.801145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:20.801417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:20.864283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:20.865699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:20.955775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 595/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:01:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:01:20.961649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:21.053064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e51ed0-1e71-4626-aada-01b3d5776f1c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:21.083902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:21.084747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:21.085024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:21.085293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] PATH_INFO: `/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:21.086436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] RBAC: Authorizing `identity:get_project(project_id=ecf4cd29436a4c44aa33c4f4d847948f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:21.087878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c5346-03e5-438c-a52e-b147c884354f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:21.089533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 589/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:20 2022] GET /identity/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f => generated 361 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:21.096154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:21.188654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b198f3c-9a44-4a11-8b5c-4a6bcacffe5a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:21.220802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:21.221437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:21.221714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:21.221987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:21.222819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=ecf4cd29436a4c44aa33c4f4d847948f, user.id=1ee1141d959c495d85bb8a18da044886) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:21.223121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:21.224511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df313ed4-1913-476f-a9b4-2a5f7a474291 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:21.229624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 596/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:01:21 2022] GET /identity/v3/role_assignments?user.id=1ee1141d959c495d85bb8a18da044886&scope.project.id=ecf4cd29436a4c44aa33c4f4d847948f&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:23.398558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ae9b-7ab2-4a61-a078-2ff2811ea541 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:23.399123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ae9b-7ab2-4a61-a078-2ff2811ea541 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:23.399123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ae9b-7ab2-4a61-a078-2ff2811ea541 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:23.400510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 590/1186] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:23.405546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:23.405926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:23.406087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:23.423740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:23.424978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:23.486746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 597/1187] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:23.508637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ae9b-7ab2-4a61-a078-2ff2811ea541 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:23.604603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ae9b-7ab2-4a61-a078-2ff2811ea541 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:23.635822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:23.636599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:23.636884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:23.637160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:23.647450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:23.655124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:23.656232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:01:23.657758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 591/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:23.662628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:23.753251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c06de3-2082-4e44-83a1-f221cb6e1556 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:23.785091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:23.785735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:23.786012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:23.786282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:23.787033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:23.787333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:23.788677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:23.796135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 598/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:23.802257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:23.896528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f7d9f-5766-47e1-96da-5d38307fe757 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:23.927458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:23.928324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:23.928608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:23.928886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] PATH_INFO: `/v3/users/1ee1141d959c495d85bb8a18da044886` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:23.930054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee1141d959c495d85bb8a18da044886)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:23.931521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:23.933130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 592/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:23 2022] GET /identity/v3/users/1ee1141d959c495d85bb8a18da044886 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:23.939345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:24.031522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c9722-32f6-4bcd-9266-a2bdd8e5a0bd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:24.061860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:24.062740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:24.063626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:24.063906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] PATH_INFO: `/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:24.065060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] RBAC: Authorizing `identity:get_project(project_id=ecf4cd29436a4c44aa33c4f4d847948f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:24.066480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbafdc-7266-46e1-8150-de1c95cbbb1b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:24.068316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 599/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:23 2022] GET /identity/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:24.074036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:24.167830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502def4-14b9-48e9-8ca0-a7cb7ce3f1a7 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:24.199148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:24.200020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:24.200300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:24.200571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] PATH_INFO: `/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f/users/1ee1141d959c495d85bb8a18da044886/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:24.202497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=ecf4cd29436a4c44aa33c4f4d847948f, user_id=1ee1141d959c495d85bb8a18da044886, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:24.204679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47b21a-1d9b-4014-8c68-b7f97eb5efc5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:24.217024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 593/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:01:24 2022] PUT /identity/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f/users/1ee1141d959c495d85bb8a18da044886/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:01:26.396200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98aca-579c-45d1-ad46-36c3a821a309 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:26.396735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98aca-579c-45d1-ad46-36c3a821a309 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:26.396735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea98aca-579c-45d1-ad46-36c3a821a309 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:26.398098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 600/1193] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:01:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:01:26.403374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:26.403761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:26.403937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:26.421643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:01:26.423438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:01:26.487291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 594/1194] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:01:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:01:26.509970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98aca-579c-45d1-ad46-36c3a821a309 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:26.611787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea98aca-579c-45d1-ad46-36c3a821a309 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:26.642713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:26.643486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:26.643766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:26.644034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:26.653638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:01:26.661709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:01:26.662903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:01:26.664180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 601/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:01:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:01:26.669147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:26.760616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14cbfbb-45fd-4662-9cfe-ffda1e2d140a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:26.792619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:26.793267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:26.793542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:26.793809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:26.794534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:26.794863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:26.796226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:26.804287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 595/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:01:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:26.809948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:26.903817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aef401-fa79-4336-864e-ad1d51c7401f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:26.934389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:26.935421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:26.935701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:26.935974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] PATH_INFO: `/v3/users/1ee1141d959c495d85bb8a18da044886` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:26.937135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] RBAC: Authorizing `identity:get_user(user_id=1ee1141d959c495d85bb8a18da044886)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:26.939394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:26.941017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 602/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue May 17 18:01:26 2022] GET /identity/v3/users/1ee1141d959c495d85bb8a18da044886 => generated 311 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:26.946726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:27.042264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed205b-a1fe-4743-9651-9726eca5fa30 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:27.074786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:27.075423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:27.075705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:27.075981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:27.140051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:27.143514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:27.235676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 596/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:01:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:01:27.241827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:27.334821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642e8994-9e6f-4257-8039-3444b548ee80 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:27.365769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:27.366641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:27.367022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:27.367297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] PATH_INFO: `/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:27.368447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] RBAC: Authorizing `identity:get_project(project_id=ecf4cd29436a4c44aa33c4f4d847948f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:27.369853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ecf469-d458-4d00-aa70-a91dec802d83 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:27.371534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 603/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue May 17 18:01:27 2022] GET /identity/v3/projects/ecf4cd29436a4c44aa33c4f4d847948f => generated 361 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:01:27.378422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:01:27.472611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fdf8c-e442-433a-b569-6c5dd8014bcd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:01:27.505067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:01:27.505646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:01:27.505931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:01:27.506209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:01:27.507131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=ecf4cd29436a4c44aa33c4f4d847948f, user.id=1ee1141d959c495d85bb8a18da044886) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:01:27.507446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:01:27.508875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd925f01-0590-4bec-bc69-c7145a8d696c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:01:27.514448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 597/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:01:27 2022] GET /identity/v3/role_assignments?user.id=1ee1141d959c495d85bb8a18da044886&scope.project.id=ecf4cd29436a4c44aa33c4f4d847948f&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:27.630167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a4db-bbaf-4d9e-a90b-a77c0d3f14d6 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:27.630167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a4db-bbaf-4d9e-a90b-a77c0d3f14d6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:27.630167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3a4db-bbaf-4d9e-a90b-a77c0d3f14d6 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:27.630167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 604/1201] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:27.635952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:27.636376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:27.636515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:27.653491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:27.655383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:27.737829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 598/1202] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:27.764533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3a4db-bbaf-4d9e-a90b-a77c0d3f14d6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:27.876870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3a4db-bbaf-4d9e-a90b-a77c0d3f14d6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:27.916111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:27.917248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:27.917749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:27.918293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:27.930192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:27.931294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:27.950820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:27.952419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:27.953430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:27.953430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:27.953430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:27.953430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:27.958619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 605/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:27.958765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:28.080286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0801f7-6314-4337-babf-bbf47d8819f9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:28.121477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:28.122193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:28.122472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:28.122774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:28.123861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:28.124124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:28.125565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be2e2a-6306-48df-8b20-f12060eebb26 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:28.139251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 599/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:28.144369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:28.263127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731456-cbdc-4c48-b7ab-261c2293ba4f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:28.305475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:28.306295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:28.306828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:28.307118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:28.307960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:28.309811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13290-865a-4b40-b2f6-768d6973f8f5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:28.336961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 606/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue May 17 18:02:28 2022] POST /identity/v3/users => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:02:30.745785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0206-8fd8-4b86-9934-608687da4ffc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:30.746376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0206-8fd8-4b86-9934-608687da4ffc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:30.746376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b0206-8fd8-4b86-9934-608687da4ffc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:30.751957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 600/1206] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:30.755927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:30.756427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:30.756527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:30.778665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:30.780717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:30.858389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 607/1207] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:30.887759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0206-8fd8-4b86-9934-608687da4ffc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.003857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b0206-8fd8-4b86-9934-608687da4ffc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:31.046639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:31.047461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:31.047743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:31.048015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:31.060598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:31.070746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:31.071785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:31.072722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 601/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 18:02:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:31.079708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.200808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e28d61-13e4-4c3b-a6fe-f57ab73f972c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:31.238984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:31.239895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:31.240394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:31.240649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:31.241588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:31.241926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:31.243573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:31.259120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 608/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 18:02:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:31.261130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.377256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df02c19c-9f8f-43e2-89ee-4cb2136e6d24 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:31.416945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:31.417816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:31.418144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:31.418468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:31.429615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:31.431106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:31.452668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:31.453665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:31.454656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:31.454656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:31.454656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:31.454656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:31.454656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 602/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:02:31.461384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.586440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d821d5-268c-475c-ae4f-d1a4dd554f80 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:31.627389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:31.628234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:31.628615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:31.628940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:31.629897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:31.630359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:31.634529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:31.650539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 609/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:31.652040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.766956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43a2e1-4581-4763-afdb-194f833f3010 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:31.805891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:31.806772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:31.807082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:31.807425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:31.816075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:31.818244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:31.835128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:31.836407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:31.837681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:31.839201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 603/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:31.845840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:31.961397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df183f9c-198f-4348-8c9b-c9ae70780368 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:32.008654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:32.009891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:32.010223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:32.010896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:32.011636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:32.011952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:32.013723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:32.036001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 610/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:32.042840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:32.162077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e5426-f464-40c6-a4aa-88560946450d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:32.201878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:32.202634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:32.202926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:32.203194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:32.283806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:32.285537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:32.397945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 604/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:02:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:02:32.404948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:32.514043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d091e9-b234-430e-8e66-93e77413dee8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:32.551416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:32.552455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:32.552782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:32.553242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:32.563684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:32.565165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:32.584932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:32.586084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:32.587195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:32.587195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:32.587195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:32.587195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:32.587195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 611/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:32.591961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:32.704205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4319a2d-0cc8-405a-b34f-a053e8efef49 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:32.742546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:32.743244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:32.743527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:32.743843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:32.744511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:32.744831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:32.746175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:32.762505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 605/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:32.764327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:32.868344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc7ac0-5867-43f4-a636-b186e20a66bb None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:32.903833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:32.905415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:32.905694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:32.905965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:32.912823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:32.914259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:32.930788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:32.932308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:32.933560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 612/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:32.939750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:33.051074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910aebc3-fb3f-45f0-b756-f19011233430 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:33.086157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:33.086869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:33.087155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:33.087434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:33.088306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:33.088755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:33.090263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478c095-f125-46ec-b34b-782c8e93a644 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:33.108982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 606/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:33.110123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:33.215763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d522983-c579-495f-93e5-bbce7ca4ddd8 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:33.254805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:33.255931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:33.256440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:33.256956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:33.258063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=b07f105e72884b37a1e9a9bed0415466) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:33.258597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:33.260535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74081938-134c-44b9-8218-2a1b6f665dba None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:33.270300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 613/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:02:33 2022] GET /identity/v3/role_assignments?user.id=b07f105e72884b37a1e9a9bed0415466&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:02:35.827517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f90cb-1e76-4f10-ad85-c8c4430c9435 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:35.828079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f90cb-1e76-4f10-ad85-c8c4430c9435 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:35.828079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f90cb-1e76-4f10-ad85-c8c4430c9435 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:35.829525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 607/1220] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:35.835018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:35.835501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:35.835582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:35.853677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:35.855355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:35.930726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 614/1221] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:35.958901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f90cb-1e76-4f10-ad85-c8c4430c9435 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.082941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f90cb-1e76-4f10-ad85-c8c4430c9435 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.118202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.119041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.119329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.119606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.129454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:36.137200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:36.138240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:36.139179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 608/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 18:02:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:36.144424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.249349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac177c8e-07c2-47e0-a1f9-78ac40cd2371 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.281710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.282378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.282699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.282975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.283707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:36.284008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:36.285374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:36.293114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 615/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 18:02:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:36.299886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.403238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8698c-92a7-4401-b19b-a3b9c29198c2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.439715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.440517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.440796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.441065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.452474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:36.454117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:36.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:36.473419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:36.474397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:36.474397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:36.474397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:36.474397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:36.474397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 609/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:36.479265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.582901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844e5de4-bf74-4b7d-8e41-1c5db6a94cb7 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.615430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.616093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.616369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.616636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.617345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:36.617645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:36.619043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:36.632107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 616/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:36.637820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.744853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e7c32-af51-43c8-8d24-2c0d83c2f83d None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.785288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.786350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.786668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.786941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.796490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:36.798414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:36.816347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:36.817531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:36.818526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 610/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:36.823396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:36.933919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b03d8-a724-4ec6-afde-6f4a3726931f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:36.975547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:36.976398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:36.976783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:36.977197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:36.978280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:36.978611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:36.980237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.000613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 617/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:37.006326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:37.106208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefffb1-bd2d-46b4-bcda-d9d17cbb2bd1 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:37.148131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:37.148931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:37.149213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:37.149489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:37.161199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:37.162687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:37.179541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:37.180711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:37.181952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:37.181952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:37.181952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:37.181952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:37.181952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 611/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:02:37.187023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:37.292538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f946b2c6-26e1-48a5-8c65-aa293dae5391 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:37.332415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:37.333083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:37.333367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:37.333645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:37.334359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:37.334697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:37.336055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.347995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 618/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:37.353721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:37.455544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f95f436-68b5-4c00-b354-6a4a57a40cee None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:37.493741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:37.494662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:37.494965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:37.495289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:37.503398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:37.504828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:37.520381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:37.521635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:37.522665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 612/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:37.528003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:37.633552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b23635-7feb-4da7-8337-a134aa38abf2 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:37.674201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:37.675121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:37.675515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:37.675983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:37.677032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:37.677583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:37.679597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eaddfa-d2f7-4e85-8841-6cd27eb47900 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.692212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 619/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:37.699085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:37.807070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece6c21-eaf1-478c-8455-3bcc03dec7a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:37.846688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:37.847710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:37.848203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:37.848512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/b07f105e72884b37a1e9a9bed0415466/roles/a6289f8791a549d58a79f1a4d41fc7af` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:37.865685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=b07f105e72884b37a1e9a9bed0415466, role_id=a6289f8791a549d58a79f1a4d41fc7af)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:37.867325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652879e-bf1f-4c82-a92d-fac0d5c5c0e5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:37.879758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 613/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:02:37 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/b07f105e72884b37a1e9a9bed0415466/roles/a6289f8791a549d58a79f1a4d41fc7af => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:02:40.254768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fb60-c0c4-44f6-a7e3-904c202da6b9 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:40.255313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fb60-c0c4-44f6-a7e3-904c202da6b9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:40.255313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82fb60-c0c4-44f6-a7e3-904c202da6b9 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:40.256679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 620/1233] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:40.262682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:40.263695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:40.263802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:40.283174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:40.284460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:40.355846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 614/1234] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:40.383431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fb60-c0c4-44f6-a7e3-904c202da6b9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:40.490033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82fb60-c0c4-44f6-a7e3-904c202da6b9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:40.530530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:40.531699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:40.532130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:40.532513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:40.544691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:40.554408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:40.555607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:40.556670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 621/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue May 17 18:02:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:40.564470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:40.675925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d428fe-791e-4a6f-a82f-abd1d69739b5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:40.714189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:40.715018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:40.715269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:40.715542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:40.716834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] RBAC: Adding query filter params (name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:40.717137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:40.718502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:40.726873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 615/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue May 17 18:02:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:40.734265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:40.839937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638c3341-7faa-4cac-b775-2cb39fccf4ae None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:40.880346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:40.881262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:40.881539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:40.882000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:40.894221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:40.895990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:40.916881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:40.917863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:40.924614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:40.924614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:40.924614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:40.924614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:40.924614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 622/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:02:40.925855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:41.038207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbbaf7d-d4e4-4523-a3da-1f9a8c646930 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:41.074726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:41.075390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.076319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.076690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.077407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:41.077711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:41.079154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:41.090025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 616/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:41.096697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:41.206698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4af3a6-7753-43ba-93e2-fd8739a35fbd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:41.243881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:41.244695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.244978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.245252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.253770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:41.255588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:41.271116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:41.272400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:41.273398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 623/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:41.278290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:41.399410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f403c31f-99d4-411c-bb97-7ad45ce6a9a5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:41.440352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:41.441059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.441358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.441637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.442560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:41.442958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:41.444398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:41.463254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 617/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:41.469286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:41.572973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b044299-a3c5-43bf-8c0b-3d3619f4e5da None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:41.608601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:41.609296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.609649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.609982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.688357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:41.690951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:41.796317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 624/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:02:41.797570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:41.904622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7152c59f-e767-4252-a7e0-7e6839453174 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:41.942037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:41.942900 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:41.943224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:41.943529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:41.954038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:41.955536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:41.974304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:41.975462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:41.976426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:41.976426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:41.976426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:41.976426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:41.976426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 618/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:41.981294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:42.093924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be471ab0-1fce-46d1-a588-e0296d7fbcff None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:42.131526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:42.132255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:42.132622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:42.132934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:42.133833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:42.134146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:42.135829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:42.147311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 625/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:42.154365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:42.259211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5f2ec2-bbeb-4bb5-88a9-966b28c04fd3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:42.295784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:42.296644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:42.296956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:42.297282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:42.304367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:42.305845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:42.322172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:42.323347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:42.324312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 619/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:42.330357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:42.439572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07000329-9c38-4686-9805-91f80ab2ef9a None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:42.478100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:42.478798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:42.479081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:42.479361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:42.480137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:42.480445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:42.482974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f99a67e-e883-424f-a89d-c751b19c37d0 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:42.495922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 626/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:42.503914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:42.609944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d796f14-9721-4935-906d-ae12ba993341 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:42.645367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:42.646017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:42.646296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:42.646586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:42.647403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] RBAC: Adding query filter params (role.id=a6289f8791a549d58a79f1a4d41fc7af, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=b07f105e72884b37a1e9a9bed0415466) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:42.647712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:42.649122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad4bca1-c0e5-4a32-8f52-33cf7d773b48 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:42.657291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 620/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:02:42 2022] GET /identity/v3/role_assignments?user.id=b07f105e72884b37a1e9a9bed0415466&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=a6289f8791a549d58a79f1a4d41fc7af => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:45.154839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277486e-3bf1-4b2f-bda7-ed47b6e81f61 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.155439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277486e-3bf1-4b2f-bda7-ed47b6e81f61 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.155439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c277486e-3bf1-4b2f-bda7-ed47b6e81f61 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.156917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 627/1247] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:45.162374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.162902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.163004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.179769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:45.180879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:45.268265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 621/1248] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:45.292158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277486e-3bf1-4b2f-bda7-ed47b6e81f61 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:45.399153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c277486e-3bf1-4b2f-bda7-ed47b6e81f61 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:45.434524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:45.436195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.436476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.436748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.447217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:45.455003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:45.456327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:45.457286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 628/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:45.463458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:45.582482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7cd77-cc09-4111-a06b-adc182b78c97 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:45.619706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:45.620389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.620715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.620999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.621790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:45.622102 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:45.623825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:45.633160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 622/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:45.639510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:45.746668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af61bd73-40da-4101-b46c-e8ada84a59bc None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:45.788025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:45.789008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.789356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.789598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.802526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:45.804132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:45.823087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:45.824322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:45.825567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:45.825567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:45.825567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:45.825567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:45.825567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 629/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 17 18:02:45.831612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:45.944625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59c239-9b4b-4a1f-b51e-f067f1c0945a None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:45.978099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:45.978792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:45.979072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:45.979341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:45.980047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:45.980345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:45.982220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:45.994372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 623/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:46.002533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:46.122447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5caeb30-1b64-4209-b827-809e9194e04c None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:46.160194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:46.161093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:46.161382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:46.161692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:46.170418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:46.172204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:46.187236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:46.188596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:46.189587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 630/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:46.195118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:46.296316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe19e0-3ec1-4128-923b-1667a3e60eb2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:46.330640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:46.331314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:46.331606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:46.331883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:46.332716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:46.333030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:46.334454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:46.352541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 624/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:46.358625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:46.467798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3329c-f2cd-41ee-a283-691d84bdc86d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:46.503846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:46.504499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:46.504813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:46.505100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:46.578195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:46.579623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:46.679776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 631/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:02:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:02:46.686153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:46.786165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4715cdc2-c545-499a-8b2d-73be4a7a86c5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:46.820935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:46.821750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:46.822033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:46.822311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:46.833344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:46.834774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:46.853190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:46.854346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:46.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:46.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:46.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:46.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:46.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 625/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:46.860966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:46.956745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1aa901-2984-433d-a7e0-b2b98f6b300f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:46.990599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:46.991408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:46.991728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:46.992014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:46.992805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:46.993136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:46.994702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:47.008393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 632/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:47.014550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:47.121998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8582f8aa-d3ef-40e8-9fb7-aa4cd3f1b2f8 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:47.155739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:47.156540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:47.156821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:47.157096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] PATH_INFO: `/v3/projects/service` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:47.163504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:47.164956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:47.178330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:47.179464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:47.180648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 626/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:47.185894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:47.280976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2626d70c-a4ab-4151-83e3-d926fea19fdd None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:47.312549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:47.313452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:47.313731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:47.314002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:47.314800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:47.315102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:47.316502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d808f1-05f6-4321-b2bd-90cbaa4e93e2 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:47.328334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 633/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:47.334300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:47.426738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2717d0-0c3d-4077-97b0-7dff5ecad41c None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:47.457926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:47.458559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:47.458870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:47.459149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:47.459959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=b07f105e72884b37a1e9a9bed0415466) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:47.460271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:47.461692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69dd39-74ae-4734-b947-9cd4eec673b6 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:47.466988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 627/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:02:47 2022] GET /identity/v3/role_assignments?user.id=b07f105e72884b37a1e9a9bed0415466&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 259 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:49.880228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40fe16-a880-4da6-aa6b-f7a4b594a1c0 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:49.880793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40fe16-a880-4da6-aa6b-f7a4b594a1c0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:49.880793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a40fe16-a880-4da6-aa6b-f7a4b594a1c0 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:49.882131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 634/1261] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:49.887182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:49.887571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:49.888606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:49.906158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:49.907378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:49.970338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 628/1262] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:49.992606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40fe16-a880-4da6-aa6b-f7a4b594a1c0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.101058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a40fe16-a880-4da6-aa6b-f7a4b594a1c0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.132960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.133673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.133952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.134221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.144561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:50.152192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:50.153299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:50.154275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 635/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:50.159593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.251763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a42a2d-4b83-407b-9ded-0e2300c23fb9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.283515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.284171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.284454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.284727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.285459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:50.285763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.287169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.294783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 629/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:50.300482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.395843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52fe8fd-5ee9-4fe6-ac9d-e5514862ee4d None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.426704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.427479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.427754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.428023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.438965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.440436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:50.457394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:50.458454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:50.464348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:50.464348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:50.464348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:50.464348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:50.464348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 636/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:50.464728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.558128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89731dcd-ab3f-459d-bf63-0d4b6cd88540 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.589631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.590279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.590561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.590917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.591623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:50.591926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.593277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.604304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 630/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:50.610501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.704236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ac3be6-2ea6-4eda-8215-bba84c0bba8f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.735839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.736631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.736910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.737177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] PATH_INFO: `/v3/users/placement` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.744210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.745627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:50.759967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:50.761157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:50.762149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 637/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:50.767024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:50.861757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8748ff1-6cf5-40e9-9489-12759ece9e53 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:50.893175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:50.893837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:50.894121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:50.894399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:50.895255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:50.895564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:50.896990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:50.913658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 631/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:50.920097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:51.020462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c2736-fa76-4f08-ab3e-a11334e0f119 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:51.057385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:51.058173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:51.058452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:51.058752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:51.069201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:51.070650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:51.087108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:51.088172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:51.089315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:51.089315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:51.089315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:51.089315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:51.089315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 638/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:51.094678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:51.187171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8290a-42cc-4e7c-832b-69b5ac5455de None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:51.219459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:51.220105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:51.220385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:51.220658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:51.221364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:51.221668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:51.223050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:51.233722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 632/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:51.239157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:51.336739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847d32-8c37-4ef3-b98d-b37f910d7a58 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:51.368174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:51.368948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:51.369224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:51.369490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:51.375941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:51.377363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:51.391735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:51.392802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:51.393913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 639/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:51.398596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:51.491823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0dcb6-2d4a-42c0-b4de-2d7b9ac541f3 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:51.523580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:51.524225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:51.524505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:51.524778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:51.525547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:51.525849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:51.527308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b552516f-d499-4da0-8c80-e92bd9df5970 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:51.539247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 633/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:51.545808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:51.641211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95577ee2-c5b7-4faa-8347-56b9f155818b None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:51.673793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:51.674679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:51.674953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:51.675216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] PATH_INFO: `/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/b07f105e72884b37a1e9a9bed0415466/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:51.677103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=cfd3bc2d0bfb46e59ea433d541abcaf9, user_id=b07f105e72884b37a1e9a9bed0415466, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:51.678511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc9e55-4264-4609-8bb1-edc4e7a116b3 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:51.691222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 640/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue May 17 18:02:51 2022] PUT /identity/v3/projects/cfd3bc2d0bfb46e59ea433d541abcaf9/users/b07f105e72884b37a1e9a9bed0415466/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:02:53.863550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd4b5-d07e-4289-85d0-b6bf23279daf None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:53.864085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd4b5-d07e-4289-85d0-b6bf23279daf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:53.864085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53bd4b5-d07e-4289-85d0-b6bf23279daf None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:53.865482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 634/1274] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:53.870507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:53.870936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:53.871080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:53.888028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:53.889191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:53.951453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 641/1275] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:53.974134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd4b5-d07e-4289-85d0-b6bf23279daf None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.083936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53bd4b5-d07e-4289-85d0-b6bf23279daf None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.115088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.115878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.116159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.116430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.126466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(role_id) May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 17 18:02:54.134090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:54.135236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:54.136423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 635/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue May 17 18:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:54.142027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.233633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bce663-4d8c-4024-ab52-7d5427fc3f24 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.264683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.265333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.265611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.265876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.266618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:54.266919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:54.268282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:54.275778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 642/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:54.281329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.373784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf580452-20ad-456a-8176-0823cf926de5 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.404717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.405488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.405774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.406040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.415786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:54.417204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:54.433716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:54.434999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:54.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:54.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:54.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:54.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:54.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 636/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:54.440697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.534014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c82638-1aad-40c4-8e7b-378d358d9e0e None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.564972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.565613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.565893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.566168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.566907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:54.567211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:54.568551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:54.580204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 643/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:54.585784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.677208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ac160-201e-4cdc-9bc9-5d430aca7958 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.709402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.710182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.710462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.710763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] PATH_INFO: `/v3/users/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.717763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:54.719209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_user(user_id) May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 17 18:02:54.732841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:54.733977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:54.735310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 637/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:54.739526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.832358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad0ae2-8557-46e0-b758-85991261ecf6 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:54.863264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:54.863916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:54.864196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:54.864467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:54.865289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:54.865595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:54.867041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:54.883625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 644/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:54.889147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:54.985033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2f6cf-a0fd-4cad-8aa8-55981d5f2a5b None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.020779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.021423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.021700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.021975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.084537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.086019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.177075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 638/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue May 17 18:02:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 17 18:02:55.182999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.275944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375e49fd-99a9-4c74-a5e0-672a54beba19 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.309777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.310564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.310872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.311141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.320869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.322306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 17 18:02:55.339737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:55.341447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:55.342695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 17 18:02:55.342695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 17 18:02:55.342695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 17 18:02:55.342695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:55.342695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 645/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:55.347107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.438346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18ba8c-7f0f-42c8-a3a6-58964d9661fd None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.469809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.470458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.470774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.471049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.471752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:55.472055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.473436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.484705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 639/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:55.490252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.583168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2776baf-fe1b-42c9-b2d3-735a9b0141db None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.614843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.615618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.615896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.616165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] PATH_INFO: `/v3/projects/service` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.623131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.624545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(project_id) May 17 18:02:55.638501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application with Lock( May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:55.639591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: ERROR keystone.server.flask.application May 17 18:02:55.640568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 646/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:55.645405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.738697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4827069c-d826-48eb-a1a6-eafd2fe2c7bf None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.769667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.770315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.770629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.770909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.771678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:55.771987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.773398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e89ce2-b849-44d4-9000-24eb8057316e None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.784758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 640/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:55.790673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:55.884906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f7fefe-0858-4eb1-9cbd-756ae7e5273f None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:55.915927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:55.916560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:55.916840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:55.917113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:55.917925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] RBAC: Adding query filter params (role.id=ff3f28a3c0be4c1ea32f186131664150, scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9, user.id=b07f105e72884b37a1e9a9bed0415466) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:55.918231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:55.920203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e363a7b-b9c6-4ab1-a983-a0109cf5a2cb None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:55.926083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 647/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue May 17 18:02:55 2022] GET /identity/v3/role_assignments?user.id=b07f105e72884b37a1e9a9bed0415466&scope.project.id=cfd3bc2d0bfb46e59ea433d541abcaf9&role.id=ff3f28a3c0be4c1ea32f186131664150 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:58.134789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02345bc-329a-4315-a5e4-8dbac8395939 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.135323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02345bc-329a-4315-a5e4-8dbac8395939 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.135323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02345bc-329a-4315-a5e4-8dbac8395939 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.136704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 641/1288] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:02:58.141915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.142354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.142460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.158527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:02:58.159730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:02:58.221361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 648/1289] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:02:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:02:58.243375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02345bc-329a-4315-a5e4-8dbac8395939 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:58.339018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02345bc-329a-4315-a5e4-8dbac8395939 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:58.372194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:58.373383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.373670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.373948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.374610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:58.375987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:02:58.388528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:02:58.389782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:02:58.390944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 642/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:02:58.395585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:58.487344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd9860-de2d-4da5-b5c8-37aa11050a25 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:58.521294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:58.521947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.522231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.522505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.523225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] RBAC: Adding query filter params (name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:58.523530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:58.524884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b9113d-50a2-463e-89b2-caf24f925dde None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:58.529986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 649/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 17 18:02:58 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:02:58.535597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:02:58.628935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531feef6-c300-4da6-95ca-f22228466808 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:02:58.659707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:02:58.660346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:02:58.660624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:02:58.660895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] PATH_INFO: `/v3/services` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:02:58.661575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] RBAC: Adding query filter params (type=placement) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:02:58.661881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:02:58.663263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132c3f8-f9cd-46ea-baa4-88748306431b None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:02:58.667409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 643/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 17 18:02:58 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:00.867724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1326-6b52-4603-a998-7957ff5ed3ac None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.868238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1326-6b52-4603-a998-7957ff5ed3ac None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.868333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d1326-6b52-4603-a998-7957ff5ed3ac None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.869629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 650/1293] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:00.875098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6d25f-586a-4989-bdaa-784e4c111162 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:00.875518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6d25f-586a-4989-bdaa-784e4c111162 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:00.875667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6d25f-586a-4989-bdaa-784e4c111162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:00.892338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-08d6d25f-586a-4989-bdaa-784e4c111162 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:00.893531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-08d6d25f-586a-4989-bdaa-784e4c111162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:00.958443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 644/1294] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:03:00.982140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d1326-6b52-4603-a998-7957ff5ed3ac None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:01.091742 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d1326-6b52-4603-a998-7957ff5ed3ac None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:01.122960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:01.123559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:01.123840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:01.124112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:01.124818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:01.126156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e55a25-c063-4769-9078-5db2f5e96084 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:01.138940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 651/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue May 17 18:03:00 2022] POST /identity/v3/services => generated 246 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:03:03.338949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389cdb-6633-43cb-9a19-d3f34e9db89a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.339483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389cdb-6633-43cb-9a19-d3f34e9db89a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.339483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e389cdb-6633-43cb-9a19-d3f34e9db89a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.340877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 645/1296] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:03.346591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.346968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.347158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.363893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:03.365052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:03.436796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 652/1297] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:03:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:03:03.459708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389cdb-6633-43cb-9a19-d3f34e9db89a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.555671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e389cdb-6633-43cb-9a19-d3f34e9db89a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.587148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.587931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.588209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.588481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.589173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.591059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:03.602492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:03.603741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:03.604813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 646/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:03.609854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.701955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18057f41-1d81-4f33-93f1-23f1065e7a40 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.732818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.733462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.733740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.734008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.734726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:03.735026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.736369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.741187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 653/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:03:03.747402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.839870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db89c4-9652-46e9-ae22-53eadd83b3e2 None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:03.870477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:03.871152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:03.871937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:03.872456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:03.872982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] RBAC: Adding query filter params (interface=public, service_id=c691afe466c34eacba74153a60e873e0, region_id=RegionOne) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:03.873288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:03.874670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a510f75-7970-4aa6-928c-6e79e51584ba None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:03.879418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 647/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/endpoints?service_id=c691afe466c34eacba74153a60e873e0&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:03.884923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:03.978124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7bf46-b097-48e6-a1df-cb58c0816611 None admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:04.014397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:04.015081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:04.015359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:04.015625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:04.016285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:04.017626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f5e5c-b0ac-458e-8e85-776dc33ba3a5 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:04.024194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 654/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue May 17 18:03:03 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:03:06.203143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b89c-8e99-49ca-bd49-e0926f00c023 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.203668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b89c-8e99-49ca-bd49-e0926f00c023 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.203668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3b89c-8e99-49ca-bd49-e0926f00c023 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.205043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 648/1302] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:03:06.210233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.210677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.210822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.227721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:03:06.228880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:03:06.289823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 655/1303] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:03:06 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 17 18:03:06.311691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3b89c-8e99-49ca-bd49-e0926f00c023 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:06.405418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3b89c-8e99-49ca-bd49-e0926f00c023 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:06.435735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:06.436512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.436787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.437055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] PATH_INFO: `/v3/services/placement` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.437687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:06.439328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application Traceback (most recent call last): May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 17 18:03:06.451543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._get_service(service_id) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 17 18:03:06.452715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.get_or_create( May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application with Lock( May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self._enter() May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application return self.creator() May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application created_value = creator( May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: ERROR keystone.server.flask.application May 17 18:03:06.453995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 649/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue May 17 18:03:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 141 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 17 18:03:06.458634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:06.549964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470f45-4c6d-4f1a-ae41-40144552e68c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:06.581358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:06.582004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.582280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.582549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] PATH_INFO: `/v3/services` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.583266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] RBAC: Adding query filter params (name=placement) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:03:06.583566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:06.584906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52d200-44a5-458f-aeb7-48fe84dd5e33 None admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:06.589731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 656/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue May 17 18:03:06 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:03:06.595896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:03:06.688228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a016395-d019-4e4d-86ff-e49eb581068f None admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:03:06.719497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:03:06.720077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:03:06.720354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:03:06.720626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] PATH_INFO: `/v3/endpoints` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:03:06.721348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:03:06.722735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f181b-a0af-4283-94bd-1d33ddabe063 None admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:03:06.740012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 650/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue May 17 18:03:06 2022] POST /identity/v3/endpoints => generated 331 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:04:10.291940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d9b8-4624-441c-90c3-47b7a0d09889 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.292948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d9b8-4624-441c-90c3-47b7a0d09889 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.293454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662d9b8-4624-441c-90c3-47b7a0d09889 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.300984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c4fc-1e09-4dbe-b047-d7fe4b558d48 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.301898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c4fc-1e09-4dbe-b047-d7fe4b558d48 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.302345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c51c4fc-1e09-4dbe-b047-d7fe4b558d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.304859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 657/1307] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:10 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:10.378936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6c51c4fc-1e09-4dbe-b047-d7fe4b558d48 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:10.380404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6c51c4fc-1e09-4dbe-b047-d7fe4b558d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:10.496134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 651/1308] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:10.550926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.551259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.551484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.553975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 658/1309] 10.222.0.25 () {54 vars in 964 bytes} [Tue May 17 18:04:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:10.561572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c581-aa12-4eb0-8477-3c7ec19740db None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.561865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c581-aa12-4eb0-8477-3c7ec19740db None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.562144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1452c581-aa12-4eb0-8477-3c7ec19740db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.643469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1452c581-aa12-4eb0-8477-3c7ec19740db None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:10.644699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1452c581-aa12-4eb0-8477-3c7ec19740db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:10.719328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 652/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Tue May 17 18:04:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:04:10.731040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:10.733009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:10.856638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafbc72-7e18-4565-8451-fbea2dcf3b0b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:10.932004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:10.932663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:10.932954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:10.933231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:10.934919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:11.043824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:11.045203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fda24f-c56c-48e6-9233-2a241a05c671 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:11.064138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 659/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:13.553833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.554331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.554449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.560573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 653/1312] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:13.562001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeebca-bd5a-4f4f-afbf-31a6f10c7d89 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:13.562434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeebca-bd5a-4f4f-afbf-31a6f10c7d89 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:13.562563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbeebca-bd5a-4f4f-afbf-31a6f10c7d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:13.685986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dfbeebca-bd5a-4f4f-afbf-31a6f10c7d89 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:13.687231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dfbeebca-bd5a-4f4f-afbf-31a6f10c7d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:13.802622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 660/1313] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:04:13.838502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:13.840266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:13.943797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952c6a4b-e614-49fb-a351-174af4514acc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:14.021776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:14.022337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:14.022647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:14.022927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:14.024556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:14.132470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:14.134096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba025551-1bb0-4ebf-9af1-6d88a1b63e31 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:14.153415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 654/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:16.722079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.722640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.722742 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.724127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 661/1315] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:16.730047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59035-1f59-4c24-b84e-89f47043f9e7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:16.730465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59035-1f59-4c24-b84e-89f47043f9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:16.730621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c59035-1f59-4c24-b84e-89f47043f9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:16.792288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d5c59035-1f59-4c24-b84e-89f47043f9e7 None None] MFA Rules not processed for user `02019db97dca48f884e39de75c42c568`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:16.793473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d5c59035-1f59-4c24-b84e-89f47043f9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:16.885355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 655/1316] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:04:16.923977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:16.925566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:17.033159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f1503e-e432-442a-a386-1eae3a1aeefb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:17.102372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:17.103089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:17.103366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:17.103632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:17.105358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:17.209059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:17.210482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1247de5-4e51-43ad-9f50-f8fa9c1a24a8 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:17.227806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 662/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:16 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:19.986988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.987528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.987528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:19.988917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 656/1318] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:19.994285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1d491-dbd2-490e-b29c-432ad1c75567 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:19.994709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1d491-dbd2-490e-b29c-432ad1c75567 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:19.994895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a1d491-dbd2-490e-b29c-432ad1c75567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.060769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d1a1d491-dbd2-490e-b29c-432ad1c75567 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:20.061950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d1a1d491-dbd2-490e-b29c-432ad1c75567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.153454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 663/1319] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:20.192407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:20.193919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.293473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb1dece-613c-4407-970d-b6917a479df0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:20.364811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:20.365457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:20.365739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:20.366013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:20.367695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:20.473480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:20.474866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611d0f7-9511-40bc-a223-3f21592eb6e8 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:20.492720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 657/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:23.334644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.335211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.335211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.336605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 664/1321] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:23.342481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa744b6f-be91-476b-ab99-f90a376e03a7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.342943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa744b6f-be91-476b-ab99-f90a376e03a7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.343198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa744b6f-be91-476b-ab99-f90a376e03a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.405118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fa744b6f-be91-476b-ab99-f90a376e03a7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:23.406286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fa744b6f-be91-476b-ab99-f90a376e03a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:23.496343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 658/1322] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:23.532041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:23.533678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:23.635200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1355824-0e7f-48d4-97c6-33a0b38d0a9e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:23.706532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:23.707212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:23.707491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:23.707758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:23.709359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:23.813221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:23.814681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49621e36-08d8-4fd9-a65a-4e3bc5a465af service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:23.831908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 665/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:26.096062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227a00-f0e0-412c-af30-f9e9bfbcd6ba None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.096626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227a00-f0e0-412c-af30-f9e9bfbcd6ba None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.096746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a227a00-f0e0-412c-af30-f9e9bfbcd6ba None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.098051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 659/1324] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:26.103830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa3eb-4ce5-41ca-a9f7-ae58db74f459 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.104292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa3eb-4ce5-41ca-a9f7-ae58db74f459 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.104396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfa3eb-4ce5-41ca-a9f7-ae58db74f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.168674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9cdfa3eb-4ce5-41ca-a9f7-ae58db74f459 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:26.169875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9cdfa3eb-4ce5-41ca-a9f7-ae58db74f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:26.262947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 666/1325] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:26.320288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.320679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.321066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.323153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 660/1326] 10.222.0.25 () {54 vars in 964 bytes} [Tue May 17 18:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:04:26.329323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3383c-b6d2-48b5-9f7e-38331908822c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.329615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3383c-b6d2-48b5-9f7e-38331908822c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.329895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3383c-b6d2-48b5-9f7e-38331908822c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.401198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-02f3383c-b6d2-48b5-9f7e-38331908822c None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:26.402366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-02f3383c-b6d2-48b5-9f7e-38331908822c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:26.473414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 667/1327] 10.222.0.25 () {58 vars in 1061 bytes} [Tue May 17 18:04:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:26.483114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:26.484605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:26.583664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3562949-4d8f-428e-b26b-41be0f5fd383 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:26.653402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:26.654048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:26.654325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:26.654621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:26.656242 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:26.761241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:26.762716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f572047-62ff-405b-94f4-4b0e6ab13deb service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:26.780605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 661/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:29.260247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.260838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.260838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.262167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 668/1329] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:29.267507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75e77-f8e2-4516-aa39-d04db907d37a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.267904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75e77-f8e2-4516-aa39-d04db907d37a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.268051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb75e77-f8e2-4516-aa39-d04db907d37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.331387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7eb75e77-f8e2-4516-aa39-d04db907d37a None None] MFA Rules not processed for user `02019db97dca48f884e39de75c42c568`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:29.332750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7eb75e77-f8e2-4516-aa39-d04db907d37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:29.425077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 662/1330] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:29.463361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:29.464889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:29.564671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dfcba4-4b13-495b-a0e0-c160316a798e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:29.635139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:29.635772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:29.636049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:29.636317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:29.637918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:29.740795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:29.742211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa4573-08a1-47a1-8519-3c43d0e03d7b service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:29.759893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 669/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:04:32.396384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.396939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.397110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.398588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 663/1332] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:32.404145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462915-db0a-403b-b7c6-5ccb800fbca7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.404602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462915-db0a-403b-b7c6-5ccb800fbca7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.404694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67462915-db0a-403b-b7c6-5ccb800fbca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.473321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-67462915-db0a-403b-b7c6-5ccb800fbca7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:32.474666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-67462915-db0a-403b-b7c6-5ccb800fbca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:32.582041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 670/1333] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:04:32.621992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:32.623584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:32.733732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e6257-67d8-42a3-99fa-daccd692fb04 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:32.804434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:32.805086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:32.805531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:32.805891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:32.807589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:32.912619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:32.914066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e26bf73-dd15-4544-8f44-aa9867b04d45 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:32.932467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 664/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:35.178527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.179090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.179090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.180918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 671/1335] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:35.186046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b4e8-68f4-4e8f-ad17-740c6f0d677d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.186478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b4e8-68f4-4e8f-ad17-740c6f0d677d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.186640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145b4e8-68f4-4e8f-ad17-740c6f0d677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.250821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9145b4e8-68f4-4e8f-ad17-740c6f0d677d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:35.252039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9145b4e8-68f4-4e8f-ad17-740c6f0d677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:35.347324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 665/1336] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:35.386523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:35.388074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:35.486079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1604d6-7470-4f59-8848-f1686aead749 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:35.556065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:35.556702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:35.556985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:35.557259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:35.558916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:35.661329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:35.662781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66af3e0-d64a-4c7d-9872-b53108d8ef7e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:35.680894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 672/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:38.320282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.320955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.320955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.322315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 666/1338] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:38.327437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221f0d-a7b4-44e9-b1d5-677f3e1d3e1e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.327848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221f0d-a7b4-44e9-b1d5-677f3e1d3e1e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.327988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221f0d-a7b4-44e9-b1d5-677f3e1d3e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.391334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6b221f0d-a7b4-44e9-b1d5-677f3e1d3e1e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:38.392521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6b221f0d-a7b4-44e9-b1d5-677f3e1d3e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:38.487371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 673/1339] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:38.522854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:38.525398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:38.625956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0211b2-6c88-44c0-808d-f152f2734114 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:38.694947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:38.696198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:38.696640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:38.696785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:38.698395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:38.800483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:38.801911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6c52ed-4154-4e88-bbb6-81b7c2a0c618 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:38.819293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 667/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:43.015591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.016100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.016100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.017406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 674/1341] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:43.022797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75c42-3fdf-4b3f-8bea-f3206c58e294 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.023230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75c42-3fdf-4b3f-8bea-f3206c58e294 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.023359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c75c42-3fdf-4b3f-8bea-f3206c58e294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.091670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-98c75c42-3fdf-4b3f-8bea-f3206c58e294 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:43.092860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-98c75c42-3fdf-4b3f-8bea-f3206c58e294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:43.192874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 668/1342] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:43.231829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:43.233924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:43.328473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4835c-6293-4225-9c12-752d854fba92 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:43.331992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:43.332649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:43.332935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:43.333212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:43.343438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:43.344853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd557a94-9c2d-4a8f-ba08-3e092f85ad3e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:43.355364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 675/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:46.151930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.152439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.152439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.158997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bd40-4e15-40af-80d2-1bc02b012453 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.159455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bd40-4e15-40af-80d2-1bc02b012453 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.159781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 669/1344] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:46.159883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f1bd40-4e15-40af-80d2-1bc02b012453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.187946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-87f1bd40-4e15-40af-80d2-1bc02b012453 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:46.189136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-87f1bd40-4e15-40af-80d2-1bc02b012453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:46.266257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 676/1345] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:04:46.303365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:46.305923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:46.319386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ee9cca-5730-4c2d-b135-55aeabaf30c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:46.324177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:46.325094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:46.325376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:46.325648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:46.335539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:46.337670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e0fec-2074-420f-a811-a3edc36197ef service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:46.347907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 670/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:50.864041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cdd54-0cd3-4c85-8e96-a883cd583753 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.864704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cdd54-0cd3-4c85-8e96-a883cd583753 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.864704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cdd54-0cd3-4c85-8e96-a883cd583753 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.865984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 677/1347] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:50.872398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acc66-4c71-4911-bb31-a134e348ec36 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.872846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acc66-4c71-4911-bb31-a134e348ec36 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.873031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54acc66-4c71-4911-bb31-a134e348ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.892691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d54acc66-4c71-4911-bb31-a134e348ec36 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:50.893818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d54acc66-4c71-4911-bb31-a134e348ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:50.902035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 671/1348] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:04:50.941531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cdd54-0cd3-4c85-8e96-a883cd583753 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:04:50.952125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cdd54-0cd3-4c85-8e96-a883cd583753 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:04:50.955586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:04:50.956224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:50.956503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:50.956776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:50.966429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:04:50.967897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb11db3-0a62-43af-bc21-2c41d60f5c31 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:04:50.977839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 678/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:04:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:04:56.372046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1046b-99e6-42f9-bac1-8c364d88bfbb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.372896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1046b-99e6-42f9-bac1-8c364d88bfbb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.373315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1046b-99e6-42f9-bac1-8c364d88bfbb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.375139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 672/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:04:56.380030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7434-9e9d-45f3-a5ed-cd29fc8674e4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:04:56.380781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7434-9e9d-45f3-a5ed-cd29fc8674e4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:04:56.381200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b7434-9e9d-45f3-a5ed-cd29fc8674e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:04:56.532410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-816b7434-9e9d-45f3-a5ed-cd29fc8674e4 None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:04:56.533844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-816b7434-9e9d-45f3-a5ed-cd29fc8674e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:04:56.697147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 679/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:04:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:00.822871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b52b-3a8a-47fe-a385-4d23a96ddaba None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:00.823462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b52b-3a8a-47fe-a385-4d23a96ddaba None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:00.823562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5b52b-3a8a-47fe-a385-4d23a96ddaba None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:00.825232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 673/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:00.830256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f938a-a642-46bc-864a-0ee8706b7675 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:00.831058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f938a-a642-46bc-864a-0ee8706b7675 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:00.831335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f938a-a642-46bc-864a-0ee8706b7675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:00.849812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ef7f938a-a642-46bc-864a-0ee8706b7675 None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:00.851177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ef7f938a-a642-46bc-864a-0ee8706b7675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:00.860226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 680/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:05:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:02.472681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd1a7-6e65-4686-a387-8fb182731d69 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.473209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd1a7-6e65-4686-a387-8fb182731d69 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.473209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd1a7-6e65-4686-a387-8fb182731d69 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.474593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 674/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:02.479983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f415f9-3aac-437f-99e9-6626be6c882d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:02.480426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f415f9-3aac-437f-99e9-6626be6c882d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:02.480697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f415f9-3aac-437f-99e9-6626be6c882d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:02.499004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-85f415f9-3aac-437f-99e9-6626be6c882d None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:02.500241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-85f415f9-3aac-437f-99e9-6626be6c882d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:02.508861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 681/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:05:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:05:06.298606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086374-9b28-4c11-8e19-cd52ea2e49cb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:06.299156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086374-9b28-4c11-8e19-cd52ea2e49cb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:06.299156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c086374-9b28-4c11-8e19-cd52ea2e49cb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:06.300681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 675/1356] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:06.306071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e5d3-73d1-44fb-bde8-4bdbc8efa1bf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:06.306481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e5d3-73d1-44fb-bde8-4bdbc8efa1bf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:06.306648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730e5d3-73d1-44fb-bde8-4bdbc8efa1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:06.325824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1730e5d3-73d1-44fb-bde8-4bdbc8efa1bf None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:06.327128 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1730e5d3-73d1-44fb-bde8-4bdbc8efa1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:06.335184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 682/1357] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:06.383691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9aa1-d6b1-41b1-8205-51f9f4557814 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:06.383984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9aa1-d6b1-41b1-8205-51f9f4557814 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:06.384259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1b9aa1-d6b1-41b1-8205-51f9f4557814 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:06.385850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 676/1358] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 17 18:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:06.391404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6866e1-3b06-40e0-bc23-e6bc80e1dbfd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:06.391788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6866e1-3b06-40e0-bc23-e6bc80e1dbfd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:06.392139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6866e1-3b06-40e0-bc23-e6bc80e1dbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:06.451830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dc6866e1-3b06-40e0-bc23-e6bc80e1dbfd None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:06.453010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dc6866e1-3b06-40e0-bc23-e6bc80e1dbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:06.534752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 683/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 17 18:05:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:06.542762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9aa1-d6b1-41b1-8205-51f9f4557814 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:06.557509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1b9aa1-d6b1-41b1-8205-51f9f4557814 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:06.562962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:06.563956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:06.564313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:06.564661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:06.574264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:06.576140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe1303-792b-4843-872b-cf3704b94509 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:06.589148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 677/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:05:09.060496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884032c-fb1c-4fb9-bc12-2a394f7f69ca None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.061049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884032c-fb1c-4fb9-bc12-2a394f7f69ca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.061049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884032c-fb1c-4fb9-bc12-2a394f7f69ca None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.062345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 684/1361] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:09.067990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c7d0-7dc2-4d30-9527-d89e5cac12ef None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.068498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c7d0-7dc2-4d30-9527-d89e5cac12ef None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.068595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5c7d0-7dc2-4d30-9527-d89e5cac12ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.086870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-04b5c7d0-7dc2-4d30-9527-d89e5cac12ef None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:09.088055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-04b5c7d0-7dc2-4d30-9527-d89e5cac12ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:09.096891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 678/1362] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:09.142812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884032c-fb1c-4fb9-bc12-2a394f7f69ca None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:09.158335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884032c-fb1c-4fb9-bc12-2a394f7f69ca None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:09.163800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:09.164481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:09.164766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:09.165185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:09.173422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:09.175156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a5448b-a988-4234-aa22-768f986eabc8 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:09.185032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 685/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:11.719252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd695a-a4ec-44a5-b0f1-d2f2a4a33a0a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.719731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd695a-a4ec-44a5-b0f1-d2f2a4a33a0a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.719859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd695a-a4ec-44a5-b0f1-d2f2a4a33a0a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.721188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 679/1364] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:11.726494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aad47-2de2-47aa-beab-27e5bd97bde3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.726934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aad47-2de2-47aa-beab-27e5bd97bde3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.727295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49aad47-2de2-47aa-beab-27e5bd97bde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.746099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b49aad47-2de2-47aa-beab-27e5bd97bde3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:11.747310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b49aad47-2de2-47aa-beab-27e5bd97bde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:11.755130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 686/1365] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:11.803677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4637b77-15f7-4982-bf78-8aecaa1116b8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.804430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4637b77-15f7-4982-bf78-8aecaa1116b8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.805526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4637b77-15f7-4982-bf78-8aecaa1116b8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.811506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 680/1366] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 17 18:05:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:11.813024 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3ba2-6810-4c3c-931d-d5c95112f264 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.813584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3ba2-6810-4c3c-931d-d5c95112f264 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.813862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd3ba2-6810-4c3c-931d-d5c95112f264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.832354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dcdd3ba2-6810-4c3c-931d-d5c95112f264 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:11.833535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dcdd3ba2-6810-4c3c-931d-d5c95112f264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:11.843496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 687/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 17 18:05:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:05:11.852133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4637b77-15f7-4982-bf78-8aecaa1116b8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:11.866136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4637b77-15f7-4982-bf78-8aecaa1116b8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:11.871663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:11.872372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:11.872650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:11.872926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:11.880829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:11.882467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca521d1-6888-4bbe-a7e8-6d89afac7553 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:11.892143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 681/1368] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:05:14.186112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6675d-ca9c-433b-ae38-9b6dd8d04d4f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.186698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6675d-ca9c-433b-ae38-9b6dd8d04d4f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.186698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6675d-ca9c-433b-ae38-9b6dd8d04d4f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.188144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 688/1369] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:14.193789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69742-1d48-4083-8d73-50e2460ca11c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.194259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69742-1d48-4083-8d73-50e2460ca11c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.194380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc69742-1d48-4083-8d73-50e2460ca11c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.214496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3bc69742-1d48-4083-8d73-50e2460ca11c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:14.215953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3bc69742-1d48-4083-8d73-50e2460ca11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:14.228757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 682/1370] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:14.274475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6675d-ca9c-433b-ae38-9b6dd8d04d4f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:14.289194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6675d-ca9c-433b-ae38-9b6dd8d04d4f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:14.294861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:14.295610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.295966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.296314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.305242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:14.306851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4b5538-41a7-48c2-85c2-e68b37c4f347 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:14.317554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 689/1371] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:14.547292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d12d-ed21-453b-a007-dbc07c9e2114 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.547527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d12d-ed21-453b-a007-dbc07c9e2114 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.547757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52d12d-ed21-453b-a007-dbc07c9e2114 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.549481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 683/1372] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:14.555968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94da0b-7422-4c80-9fd2-450ce58effe6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.556259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94da0b-7422-4c80-9fd2-450ce58effe6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.556783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94da0b-7422-4c80-9fd2-450ce58effe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.576186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0e94da0b-7422-4c80-9fd2-450ce58effe6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:14.577466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e94da0b-7422-4c80-9fd2-450ce58effe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:14.586639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 690/1373] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:14.902325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062771c-bcb4-4fdb-bd45-250d387a60a6 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.902735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062771c-bcb4-4fdb-bd45-250d387a60a6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.903024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062771c-bcb4-4fdb-bd45-250d387a60a6 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.904567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 684/1374] 10.222.0.25 () {54 vars in 963 bytes} [Tue May 17 18:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:14.909745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870038e6-1e63-47ea-835d-ae4a7845215e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:14.909940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870038e6-1e63-47ea-835d-ae4a7845215e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:14.910215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870038e6-1e63-47ea-835d-ae4a7845215e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:14.960321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-870038e6-1e63-47ea-835d-ae4a7845215e None None] MFA Rules not processed for user `0292f8e2e5ff4fe8939c078d01993ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:14.961816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-870038e6-1e63-47ea-835d-ae4a7845215e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:15.024989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 691/1375] 10.222.0.25 () {58 vars in 1060 bytes} [Tue May 17 18:05:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:05:15.032455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062771c-bcb4-4fdb-bd45-250d387a60a6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:15.043580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062771c-bcb4-4fdb-bd45-250d387a60a6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:15.047125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:15.047769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:15.048046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:15.048322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:15.057895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:15.059347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acfbb1e-3d3a-43f1-941c-c9a906bc3eef service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:15.069385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 685/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:16.594664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967abc-149b-4897-8f4f-57fadc1b7714 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.595228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967abc-149b-4897-8f4f-57fadc1b7714 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.595228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da967abc-149b-4897-8f4f-57fadc1b7714 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.596601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 692/1377] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:16.603450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5e0-15a2-4a37-a1c3-b8d67d18a68c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.604030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5e0-15a2-4a37-a1c3-b8d67d18a68c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.604030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ba5e0-15a2-4a37-a1c3-b8d67d18a68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.622195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c12ba5e0-15a2-4a37-a1c3-b8d67d18a68c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:16.623495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c12ba5e0-15a2-4a37-a1c3-b8d67d18a68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:16.631801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 686/1378] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:16.677325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967abc-149b-4897-8f4f-57fadc1b7714 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:16.692058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da967abc-149b-4897-8f4f-57fadc1b7714 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:16.698092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:16.698785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:16.699070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:16.699345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:16.708396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:16.710005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ea701b-06ee-41be-83c3-17347b6ff91f service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:16.721218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 693/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:19.027742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0b57-2fc6-4cf2-92c7-114a560e108e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:19.028327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0b57-2fc6-4cf2-92c7-114a560e108e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:19.028327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cb0b57-2fc6-4cf2-92c7-114a560e108e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:19.029646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 687/1380] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:19.034914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f751-d4d0-4fa2-83b3-734935c3d4f8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:19.035361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f751-d4d0-4fa2-83b3-734935c3d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:19.035459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7f751-d4d0-4fa2-83b3-734935c3d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:19.056261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-70a7f751-d4d0-4fa2-83b3-734935c3d4f8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:19.057605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-70a7f751-d4d0-4fa2-83b3-734935c3d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:19.066311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 694/1381] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:19.109587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0b57-2fc6-4cf2-92c7-114a560e108e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:19.124157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cb0b57-2fc6-4cf2-92c7-114a560e108e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:19.129461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:19.130089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:19.130369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:19.130667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:19.138720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:19.140293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64dd6ec-ce91-484c-abee-b16c0dc613fa service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:19.150080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 688/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:21.411023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fffd-f2cf-44f5-a130-fcbcea5ca743 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:21.411538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fffd-f2cf-44f5-a130-fcbcea5ca743 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:21.411538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625fffd-f2cf-44f5-a130-fcbcea5ca743 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:21.412855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 695/1383] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:21.419108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428ea-db7d-4ff5-ba3c-8f11cde25bb9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:21.419580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428ea-db7d-4ff5-ba3c-8f11cde25bb9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:21.419679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77428ea-db7d-4ff5-ba3c-8f11cde25bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:21.437642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a77428ea-db7d-4ff5-ba3c-8f11cde25bb9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:21.439099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a77428ea-db7d-4ff5-ba3c-8f11cde25bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:21.447229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 689/1384] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:21.487547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fffd-f2cf-44f5-a130-fcbcea5ca743 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:21.504836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625fffd-f2cf-44f5-a130-fcbcea5ca743 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:21.511440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:21.512227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:21.512542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:21.512820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:21.522682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:21.525598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7726c-411f-4564-92c7-1cbe0fa5d7a8 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:21.538269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 696/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:23.790031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa33a-5d63-4bcf-970d-88ab59a02894 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.790605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa33a-5d63-4bcf-970d-88ab59a02894 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.790605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743aa33a-5d63-4bcf-970d-88ab59a02894 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.792002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 690/1386] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:23.797399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8420b-9095-43c2-8679-becf023ca4e2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.797904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8420b-9095-43c2-8679-becf023ca4e2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.797904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8420b-9095-43c2-8679-becf023ca4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.815460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-71d8420b-9095-43c2-8679-becf023ca4e2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:23.816684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-71d8420b-9095-43c2-8679-becf023ca4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:23.825207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 697/1387] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:23.870376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa33a-5d63-4bcf-970d-88ab59a02894 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:23.885994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743aa33a-5d63-4bcf-970d-88ab59a02894 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:23.891957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:23.892644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:23.892931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:23.893177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:23.902591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:23.904266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f26f5b-d3be-4898-b8a6-79f7bbcf089c service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:23.914399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 691/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:26.367483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68efa5-9bf5-4e37-83fc-5f72bded502e None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.368164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68efa5-9bf5-4e37-83fc-5f72bded502e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.368164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f68efa5-9bf5-4e37-83fc-5f72bded502e None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.369373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 698/1389] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:26.375217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178294-7657-4c7c-945c-19a71c57d2f2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.375671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178294-7657-4c7c-945c-19a71c57d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.375821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08178294-7657-4c7c-945c-19a71c57d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.396532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-08178294-7657-4c7c-945c-19a71c57d2f2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:26.398399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-08178294-7657-4c7c-945c-19a71c57d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:26.407803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 692/1390] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:26.457463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68efa5-9bf5-4e37-83fc-5f72bded502e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:26.472974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f68efa5-9bf5-4e37-83fc-5f72bded502e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:26.479507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:26.480213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:26.480527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:26.480833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:26.489944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:26.491800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f06e55-ca29-47ab-9d47-90feb939d38c service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:26.502069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 699/1391] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:28.768466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4100b7-c349-47dc-bda0-c5dde22950b2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:28.769149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4100b7-c349-47dc-bda0-c5dde22950b2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:28.769149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4100b7-c349-47dc-bda0-c5dde22950b2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:28.770398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 693/1392] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:28.775716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153753f-ec4b-40c9-b1be-e2d2bb9190b1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:28.776146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153753f-ec4b-40c9-b1be-e2d2bb9190b1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:28.776255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c153753f-ec4b-40c9-b1be-e2d2bb9190b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:28.793875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c153753f-ec4b-40c9-b1be-e2d2bb9190b1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:28.795082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c153753f-ec4b-40c9-b1be-e2d2bb9190b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:28.802803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 700/1393] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:28.846705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4100b7-c349-47dc-bda0-c5dde22950b2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:28.861608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4100b7-c349-47dc-bda0-c5dde22950b2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:28.867498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:28.868137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:28.868419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:28.868698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:28.876752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:28.878328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ede2a-eb45-4f8f-819c-b64af9389d56 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:28.888248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 694/1394] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:30.707257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb5d8-775c-4ed5-bbc8-82fd30544feb None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.707824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb5d8-775c-4ed5-bbc8-82fd30544feb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.707824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bb5d8-775c-4ed5-bbc8-82fd30544feb None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.709153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 701/1395] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:30.714980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8daf4b-b599-47b9-80aa-c6e7386d2865 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.715412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8daf4b-b599-47b9-80aa-c6e7386d2865 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.715515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8daf4b-b599-47b9-80aa-c6e7386d2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.733153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eb8daf4b-b599-47b9-80aa-c6e7386d2865 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:30.734312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eb8daf4b-b599-47b9-80aa-c6e7386d2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:30.742062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 695/1396] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:30.797479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b39-dec0-49cb-abfe-f674ea2bd1f1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.797839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b39-dec0-49cb-abfe-f674ea2bd1f1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.798122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a7b39-dec0-49cb-abfe-f674ea2bd1f1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.799501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 702/1397] 10.222.0.25 () {54 vars in 962 bytes} [Tue May 17 18:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:05:30.804409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c28dc-c2d4-454d-a23d-fbf593b1ed43 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.804762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c28dc-c2d4-454d-a23d-fbf593b1ed43 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.805126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c28dc-c2d4-454d-a23d-fbf593b1ed43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.850560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-232c28dc-c2d4-454d-a23d-fbf593b1ed43 None None] MFA Rules not processed for user `8730a384ede5490eaa8e818e7c60518d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:30.852576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-232c28dc-c2d4-454d-a23d-fbf593b1ed43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:30.908983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 696/1398] 10.222.0.25 () {58 vars in 1059 bytes} [Tue May 17 18:05:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:05:30.917058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7b39-dec0-49cb-abfe-f674ea2bd1f1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:30.927714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a7b39-dec0-49cb-abfe-f674ea2bd1f1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:30.931286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:30.931929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:30.932207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:30.932478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:30.941616 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:30.943073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a807f-3213-4cab-9781-210b40e6940b service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:30.954409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 703/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:31.142171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db12ec-dc17-45dd-84db-accaa984c645 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.142471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db12ec-dc17-45dd-84db-accaa984c645 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.142787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81db12ec-dc17-45dd-84db-accaa984c645 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.144171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 697/1400] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:31.150160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a32-0661-4448-8da5-dd5c9d081e94 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.150461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a32-0661-4448-8da5-dd5c9d081e94 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.150775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a95a32-0661-4448-8da5-dd5c9d081e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.168446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c9a95a32-0661-4448-8da5-dd5c9d081e94 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:31.169637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c9a95a32-0661-4448-8da5-dd5c9d081e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:31.178137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 704/1401] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:31.223690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db12ec-dc17-45dd-84db-accaa984c645 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:31.238546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81db12ec-dc17-45dd-84db-accaa984c645 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:31.244862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:31.245579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.245940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.246279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.254774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:31.256434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf9b888-2232-4e95-8bda-cf22c846bebf service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:31.266441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 698/1402] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:31.387048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734fec-248a-484f-841f-251c84032e54 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.387344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734fec-248a-484f-841f-251c84032e54 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.387625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734fec-248a-484f-841f-251c84032e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.441895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-df734fec-248a-484f-841f-251c84032e54 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:31.443155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-df734fec-248a-484f-841f-251c84032e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:31.509106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 705/1403] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:31.550700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea994-64f9-464a-95eb-3628b7accf69 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.551067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea994-64f9-464a-95eb-3628b7accf69 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.551413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea994-64f9-464a-95eb-3628b7accf69 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.552876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 699/1404] 10.222.0.25 () {54 vars in 942 bytes} [Tue May 17 18:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:31.559395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bab1fe-8e6b-4106-a776-650f8b9d6eb2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.559680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bab1fe-8e6b-4106-a776-650f8b9d6eb2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.559963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bab1fe-8e6b-4106-a776-650f8b9d6eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.607709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-46bab1fe-8e6b-4106-a776-650f8b9d6eb2 None None] MFA Rules not processed for user `8ecb9355635e486aa8e5f9e4d38ead62`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:31.608881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-46bab1fe-8e6b-4106-a776-650f8b9d6eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:31.680910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 706/1405] 10.222.0.25 () {58 vars in 1039 bytes} [Tue May 17 18:05:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:31.690590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bea994-64f9-464a-95eb-3628b7accf69 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:31.704507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bea994-64f9-464a-95eb-3628b7accf69 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:31.709553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:31.710911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:31.711215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:31.711492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:31.719412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:31.720987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257505-a32a-4001-b4f2-873dbcf32e0e service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:31.728889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 700/1406] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:05:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:05:33.595769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f97e4-c77b-4b51-84eb-221c19867c6c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:33.596338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f97e4-c77b-4b51-84eb-221c19867c6c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:33.596708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f97e4-c77b-4b51-84eb-221c19867c6c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:33.598095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 707/1407] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:33.603606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb3c16-6c31-4dcd-b99f-02569149b589 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:33.604438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb3c16-6c31-4dcd-b99f-02569149b589 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:33.604728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9beb3c16-6c31-4dcd-b99f-02569149b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:33.623709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9beb3c16-6c31-4dcd-b99f-02569149b589 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:33.624904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9beb3c16-6c31-4dcd-b99f-02569149b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:33.633381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:05:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:33.677449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f97e4-c77b-4b51-84eb-221c19867c6c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:33.695185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f97e4-c77b-4b51-84eb-221c19867c6c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:33.700958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:33.701824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:33.702105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:33.702378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:33.711354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:33.712940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ccb47d-4e89-467a-a1e6-cffd2bcb9321 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:33.723174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 708/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:55.046903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c676f-ac64-4cb1-a5bb-1f96ad51936f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.048314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c676f-ac64-4cb1-a5bb-1f96ad51936f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.048314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c676f-ac64-4cb1-a5bb-1f96ad51936f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.049217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 702/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue May 17 18:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:55.055690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87f58-a26e-4a4f-9e54-b727db795082 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.056278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87f58-a26e-4a4f-9e54-b727db795082 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.056278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa87f58-a26e-4a4f-9e54-b727db795082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.074470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0aa87f58-a26e-4a4f-9e54-b727db795082 None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:55.075722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0aa87f58-a26e-4a4f-9e54-b727db795082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:55.085719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue May 17 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:55.102231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076999-8f55-496e-86e4-a38af96904f4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.102525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076999-8f55-496e-86e4-a38af96904f4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.102847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4076999-8f55-496e-86e4-a38af96904f4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.104234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 703/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue May 17 18:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:55.109045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74755966-3ce0-4876-b71b-1725709153ff None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:55.109337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74755966-3ce0-4876-b71b-1725709153ff None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:55.109614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74755966-3ce0-4876-b71b-1725709153ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:55.131287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-74755966-3ce0-4876-b71b-1725709153ff None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:55.133225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-74755966-3ce0-4876-b71b-1725709153ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:55.144723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue May 17 18:05:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:57.863274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1bba-979d-4f34-a51b-12013952beab None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:57.863852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1bba-979d-4f34-a51b-12013952beab None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:57.863852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f1bba-979d-4f34-a51b-12013952beab None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:57.865202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:57.871273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44362-db0e-43e4-b667-0eb4753efaf0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:57.871733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44362-db0e-43e4-b667-0eb4753efaf0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:57.871870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f44362-db0e-43e4-b667-0eb4753efaf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:57.889465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-72f44362-db0e-43e4-b667-0eb4753efaf0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:57.890656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-72f44362-db0e-43e4-b667-0eb4753efaf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:57.898211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:05:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:57.940640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f1bba-979d-4f34-a51b-12013952beab None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:57.956638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f1bba-979d-4f34-a51b-12013952beab None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:57.961877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:57.962513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:57.962822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:57.963085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:57.971404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:57.972979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353e2a2-277d-4180-982a-4341f670acf4 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:57.982974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 705/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:05:58.960848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cf89-6815-43d7-97f4-579d254c3a4a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.961357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cf89-6815-43d7-97f4-579d254c3a4a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.961466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8cf89-6815-43d7-97f4-579d254c3a4a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.962775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:05:58.967747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d9f1-75b0-4ef8-bac4-66b7d9078e85 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:58.968219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d9f1-75b0-4ef8-bac4-66b7d9078e85 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:58.968334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2868d9f1-75b0-4ef8-bac4-66b7d9078e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:58.985513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2868d9f1-75b0-4ef8-bac4-66b7d9078e85 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:05:58.986809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2868d9f1-75b0-4ef8-bac4-66b7d9078e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:05:58.994626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:05:59.166008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8cf89-6815-43d7-97f4-579d254c3a4a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:05:59.180799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8cf89-6815-43d7-97f4-579d254c3a4a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:05:59.186072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:05:59.186804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:05:59.187089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:05:59.187366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:05:59.196078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:05:59.197637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd30b2-5990-4b4f-a421-2da99c75ce4b service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:05:59.206751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 713/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:05:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:00.154520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d90e5-cda1-4c4b-9322-0f592d13286d None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:00.155089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d90e5-cda1-4c4b-9322-0f592d13286d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:00.155235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d90e5-cda1-4c4b-9322-0f592d13286d None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:00.156509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:00.161329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84de8d-fa60-470d-aa92-6384f6287984 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:00.161734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84de8d-fa60-470d-aa92-6384f6287984 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:00.161877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84de8d-fa60-470d-aa92-6384f6287984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:00.179691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ea84de8d-fa60-470d-aa92-6384f6287984 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:00.180790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea84de8d-fa60-470d-aa92-6384f6287984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:00.188347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:00.337105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d90e5-cda1-4c4b-9322-0f592d13286d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:00.351113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d90e5-cda1-4c4b-9322-0f592d13286d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:00.356411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:00.357040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:00.357319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:00.357590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:00.365397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:00.367107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c896748d-3011-4d83-aeb4-507fd2e8ea81 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:00.376162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 708/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:01.308632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb109d-e099-4f37-8f3a-27e172e18e1a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.309246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb109d-e099-4f37-8f3a-27e172e18e1a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.309246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb109d-e099-4f37-8f3a-27e172e18e1a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.310651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:01.316009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123cb1b-6051-4726-a3ef-9cbbb9101dc0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.316443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123cb1b-6051-4726-a3ef-9cbbb9101dc0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.316764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123cb1b-6051-4726-a3ef-9cbbb9101dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.335922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3123cb1b-6051-4726-a3ef-9cbbb9101dc0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:01.337085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3123cb1b-6051-4726-a3ef-9cbbb9101dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:01.344757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:01.498071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb109d-e099-4f37-8f3a-27e172e18e1a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:01.512791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb109d-e099-4f37-8f3a-27e172e18e1a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:01.518044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:01.518705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:01.518985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:01.519255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:01.527100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:01.528651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec3aa2-3087-44fa-b70a-e3bf84432c69 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:01.537564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 716/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:02.486303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320a9cb-8f08-4592-bddd-208702294c03 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.486897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320a9cb-8f08-4592-bddd-208702294c03 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.486897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2320a9cb-8f08-4592-bddd-208702294c03 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.488296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:02.494411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee6c-8787-41f8-bb2e-64b276d26c32 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.494864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee6c-8787-41f8-bb2e-64b276d26c32 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.494998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5ee6c-8787-41f8-bb2e-64b276d26c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.512263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-92a5ee6c-8787-41f8-bb2e-64b276d26c32 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:02.513482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-92a5ee6c-8787-41f8-bb2e-64b276d26c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:02.521161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:02.669553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320a9cb-8f08-4592-bddd-208702294c03 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:02.683941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2320a9cb-8f08-4592-bddd-208702294c03 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:02.689437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:02.690067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:02.690343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:02.690650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:02.699009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:02.700565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d05d1-8c79-44b3-9827-b8baad2325a2 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:02.709519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 711/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:03.586437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badbac-481f-4ea9-9bf9-a7e24c2428c2 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:03.587049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badbac-481f-4ea9-9bf9-a7e24c2428c2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:03.587049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65badbac-481f-4ea9-9bf9-a7e24c2428c2 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:03.588402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:03.593307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a86c3-c05a-4313-b6e8-d1e18387392f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:03.593744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a86c3-c05a-4313-b6e8-d1e18387392f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:03.593853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a86c3-c05a-4313-b6e8-d1e18387392f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:03.611487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f34a86c3-c05a-4313-b6e8-d1e18387392f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:03.612665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f34a86c3-c05a-4313-b6e8-d1e18387392f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:03.620853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:03.768035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badbac-481f-4ea9-9bf9-a7e24c2428c2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:03.782374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65badbac-481f-4ea9-9bf9-a7e24c2428c2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:03.788294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:03.788946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:03.789231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:03.789625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:03.797559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:03.799160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e72672-c604-4e80-b643-5791bac56285 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:03.808453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 719/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:04.671911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382420-7560-4c3d-9bfd-c439be02dc5f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.672432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382420-7560-4c3d-9bfd-c439be02dc5f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.672432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11382420-7560-4c3d-9bfd-c439be02dc5f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.673741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:04.679133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b273da-40d4-47f6-9857-2d08cce522fc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.679548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b273da-40d4-47f6-9857-2d08cce522fc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.679677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b273da-40d4-47f6-9857-2d08cce522fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.697563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-63b273da-40d4-47f6-9857-2d08cce522fc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:04.698756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-63b273da-40d4-47f6-9857-2d08cce522fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:04.706294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:04.856091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11382420-7560-4c3d-9bfd-c439be02dc5f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:04.870693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11382420-7560-4c3d-9bfd-c439be02dc5f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:04.875961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:04.876587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:04.876866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:04.877137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:04.885107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:04.886702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0712faa-d704-4c11-9aa4-93f862c1249f service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:04.895680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 714/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:05.758603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed98f6-0fe2-48e0-96a7-fdb47b61ff17 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.759178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed98f6-0fe2-48e0-96a7-fdb47b61ff17 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.759178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ed98f6-0fe2-48e0-96a7-fdb47b61ff17 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.760525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:05.765420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3492-5e9e-48a3-a000-ec571897b676 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.765851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3492-5e9e-48a3-a000-ec571897b676 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.765972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec3492-5e9e-48a3-a000-ec571897b676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.783808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bcec3492-5e9e-48a3-a000-ec571897b676 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:05.785005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bcec3492-5e9e-48a3-a000-ec571897b676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:05.792684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:05.940765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed98f6-0fe2-48e0-96a7-fdb47b61ff17 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:05.955087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ed98f6-0fe2-48e0-96a7-fdb47b61ff17 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:05.960437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:05.961071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:05.961348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:05.961619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:05.969583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:05.971174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258679d-efd7-425a-bae7-93cd7533271f service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:05.980286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 722/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:06.854330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34362fa-5d87-4683-90ec-efd7e99e9482 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:06.854934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34362fa-5d87-4683-90ec-efd7e99e9482 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:06.854934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34362fa-5d87-4683-90ec-efd7e99e9482 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:06.856275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:06.861713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f008e-7519-45c7-b437-39cb6ac731c1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:06.862152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f008e-7519-45c7-b437-39cb6ac731c1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:06.862262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f008e-7519-45c7-b437-39cb6ac731c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:06.879943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b30f008e-7519-45c7-b437-39cb6ac731c1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:06.881110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b30f008e-7519-45c7-b437-39cb6ac731c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:06.889137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:06:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:07.037206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34362fa-5d87-4683-90ec-efd7e99e9482 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:07.051279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34362fa-5d87-4683-90ec-efd7e99e9482 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:07.056777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:07.057406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:07.057682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:07.057958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:07.065898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:07.067508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff8218-006a-43f1-85c7-bb7eb563c029 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:07.077141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 717/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:09.165484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f877c-063f-409b-a82e-c28a6b8a4271 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:09.166069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f877c-063f-409b-a82e-c28a6b8a4271 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:09.166069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25f877c-063f-409b-a82e-c28a6b8a4271 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:09.167459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:06:09.172835 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcc407-8a75-444f-ae1b-a113b5061bbe None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:09.173258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcc407-8a75-444f-ae1b-a113b5061bbe None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:09.173378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbcc407-8a75-444f-ae1b-a113b5061bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:09.191180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9cbcc407-8a75-444f-ae1b-a113b5061bbe None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:09.192341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9cbcc407-8a75-444f-ae1b-a113b5061bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:09.200452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:06:09.238528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f877c-063f-409b-a82e-c28a6b8a4271 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:09.249383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25f877c-063f-409b-a82e-c28a6b8a4271 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:09.252825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:09.253461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:09.253737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:09.254006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:09.262537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:09.263960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3b628-98b7-40f8-a3ed-1c624c9839df service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:09.273528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 725/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:06:11.635408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094233f-1026-40ab-a564-bb7230cb944c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:11.635997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094233f-1026-40ab-a564-bb7230cb944c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:11.635997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094233f-1026-40ab-a564-bb7230cb944c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:11.637358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:11.642916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2dd9-9936-43b7-9e03-074bafeae571 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:11.643356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2dd9-9936-43b7-9e03-074bafeae571 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:11.643454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2dd9-9936-43b7-9e03-074bafeae571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:11.660953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b05c2dd9-9936-43b7-9e03-074bafeae571 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:11.662149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b05c2dd9-9936-43b7-9e03-074bafeae571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:11.669890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:06:11.707448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094233f-1026-40ab-a564-bb7230cb944c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:11.718387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094233f-1026-40ab-a564-bb7230cb944c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:11.721886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:11.722512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:11.722826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:11.723094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:11.731945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:11.733346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133c6153-3cf9-4787-af2a-e298eac51bce service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:11.742470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 720/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:14.257965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c30a-926f-4918-9632-6d699df757d6 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:14.258529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c30a-926f-4918-9632-6d699df757d6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:14.258529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107c30a-926f-4918-9632-6d699df757d6 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:14.259925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:14.265300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820adf-8d74-4b9d-9ea8-c0e229076a9c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:14.265725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820adf-8d74-4b9d-9ea8-c0e229076a9c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:14.265849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3820adf-8d74-4b9d-9ea8-c0e229076a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:14.282829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e3820adf-8d74-4b9d-9ea8-c0e229076a9c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:14.283994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e3820adf-8d74-4b9d-9ea8-c0e229076a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:14.291772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:14.330338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107c30a-926f-4918-9632-6d699df757d6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:14.340935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107c30a-926f-4918-9632-6d699df757d6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:14.344458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:14.345093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:14.345376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:14.346010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:14.355031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:14.356475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190512a9-9e3e-47d5-ad5e-90a207394c47 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:14.365506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 728/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:16.757831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53cba-fa56-4eca-9eb6-56bc4a44eb06 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:16.758447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53cba-fa56-4eca-9eb6-56bc4a44eb06 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:16.758447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a53cba-fa56-4eca-9eb6-56bc4a44eb06 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:16.759816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:06:16.765223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81194c64-6e89-45e9-8b45-7f575a2e04a7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:16.765677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81194c64-6e89-45e9-8b45-7f575a2e04a7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:16.765822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81194c64-6e89-45e9-8b45-7f575a2e04a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:16.782900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-81194c64-6e89-45e9-8b45-7f575a2e04a7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:16.784070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-81194c64-6e89-45e9-8b45-7f575a2e04a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:16.792288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:16.830951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a53cba-fa56-4eca-9eb6-56bc4a44eb06 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:16.841314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a53cba-fa56-4eca-9eb6-56bc4a44eb06 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:16.844796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:16.845423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:16.845701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:16.845972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:16.855116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:16.856533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c461e1-698a-4b4e-a50f-62aecbd61ab2 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:16.865491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 723/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:19.275668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78bb5-ced9-481c-addb-ef6bd1c79cac None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:19.276241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78bb5-ced9-481c-addb-ef6bd1c79cac None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:19.276241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c78bb5-ced9-481c-addb-ef6bd1c79cac None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:19.277616 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:19.282864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde654-1370-4653-971b-ab6d0d2e5930 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:19.283294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde654-1370-4653-971b-ab6d0d2e5930 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:19.283422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fde654-1370-4653-971b-ab6d0d2e5930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:19.300579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-86fde654-1370-4653-971b-ab6d0d2e5930 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:19.301797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-86fde654-1370-4653-971b-ab6d0d2e5930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:19.309531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:19.347349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78bb5-ced9-481c-addb-ef6bd1c79cac None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:19.358242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c78bb5-ced9-481c-addb-ef6bd1c79cac None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:19.361948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:19.362624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:19.362905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:19.363177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:19.373072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:19.374468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7456103-71aa-4613-a072-cab7f1058733 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:19.384133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 731/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:21.654059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a8c-fee9-4358-9d88-806b4b46275c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:21.654641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a8c-fee9-4358-9d88-806b4b46275c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:21.654641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afd7a8c-fee9-4358-9d88-806b4b46275c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:21.656012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:21.661418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00e39-d73e-403c-9a25-d5e1d4bcd32e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:21.661841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00e39-d73e-403c-9a25-d5e1d4bcd32e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:21.661999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a00e39-d73e-403c-9a25-d5e1d4bcd32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:21.679665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-02a00e39-d73e-403c-9a25-d5e1d4bcd32e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:21.680829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-02a00e39-d73e-403c-9a25-d5e1d4bcd32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:21.688516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:21.725731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7a8c-fee9-4358-9d88-806b4b46275c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:21.736224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afd7a8c-fee9-4358-9d88-806b4b46275c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:21.739666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:21.740288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:21.741076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:21.741478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:21.750014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:21.751462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2c87b7-aa13-4deb-a256-7e6773b1b07d service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:21.761016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 726/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:24.005882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749faf2-89f3-415e-8c8a-1f9d6402d17c None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:24.007124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749faf2-89f3-415e-8c8a-1f9d6402d17c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:24.007124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749faf2-89f3-415e-8c8a-1f9d6402d17c None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:24.008479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:24.014180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b324fc-818e-4a31-9d02-a2bbcb2d949b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:24.014697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b324fc-818e-4a31-9d02-a2bbcb2d949b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:24.014811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b324fc-818e-4a31-9d02-a2bbcb2d949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:24.032093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-55b324fc-818e-4a31-9d02-a2bbcb2d949b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:24.033270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-55b324fc-818e-4a31-9d02-a2bbcb2d949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:24.041136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:24.078974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749faf2-89f3-415e-8c8a-1f9d6402d17c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:24.089778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749faf2-89f3-415e-8c8a-1f9d6402d17c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:24.093328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:24.093972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:24.094255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:24.094562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:24.103803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:24.105205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8fa0e1-e109-4cee-9b37-4c71a1288537 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:24.114778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 734/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:26.369306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfee8-b3d4-418c-8d6f-5d03494bba1b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:26.369759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfee8-b3d4-418c-8d6f-5d03494bba1b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:26.369863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08bfee8-b3d4-418c-8d6f-5d03494bba1b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:26.371270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:26.376468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7e85-943f-4fa0-9ba8-4033624e9310 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:26.376875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7e85-943f-4fa0-9ba8-4033624e9310 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:26.377018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215b7e85-943f-4fa0-9ba8-4033624e9310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:26.394541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-215b7e85-943f-4fa0-9ba8-4033624e9310 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:26.395742 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-215b7e85-943f-4fa0-9ba8-4033624e9310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:26.403462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:26.441032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bfee8-b3d4-418c-8d6f-5d03494bba1b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:26.452237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08bfee8-b3d4-418c-8d6f-5d03494bba1b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:26.455804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:26.456454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:26.456736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:26.457015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:26.466290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:26.467748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6840c119-cb69-4bfe-9fad-13e3ce92b19a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:26.477410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 729/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:28.672090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de662-67c0-46dd-9db7-59901adb8b99 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:28.672624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de662-67c0-46dd-9db7-59901adb8b99 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:28.672624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5de662-67c0-46dd-9db7-59901adb8b99 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:28.673931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:28.679849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5ebc-b88e-4ace-a5f6-b383db81bd61 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:28.680281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5ebc-b88e-4ace-a5f6-b383db81bd61 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:28.680386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b5ebc-b88e-4ace-a5f6-b383db81bd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:28.698322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1d8b5ebc-b88e-4ace-a5f6-b383db81bd61 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:28.699521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1d8b5ebc-b88e-4ace-a5f6-b383db81bd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:28.707281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:28.743643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de662-67c0-46dd-9db7-59901adb8b99 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:28.754025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5de662-67c0-46dd-9db7-59901adb8b99 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:28.757537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:28.758166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:28.758444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:28.758799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:28.767618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:28.769022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a12835c-b96e-4f44-bb99-17201d4012cd service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:28.778170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 737/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:06:30.991908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffca3-1012-43f2-a161-5a4a543096f6 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:30.992444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffca3-1012-43f2-a161-5a4a543096f6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:30.992444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ffca3-1012-43f2-a161-5a4a543096f6 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:30.993880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:06:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:06:30.999362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c774f6-6975-43a7-88ea-8a956495977b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:30.999775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c774f6-6975-43a7-88ea-8a956495977b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:30.999920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c774f6-6975-43a7-88ea-8a956495977b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:31.017963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-68c774f6-6975-43a7-88ea-8a956495977b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:06:31.019184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-68c774f6-6975-43a7-88ea-8a956495977b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:06:31.027055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:06:31.064286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffca3-1012-43f2-a161-5a4a543096f6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:06:31.075481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ffca3-1012-43f2-a161-5a4a543096f6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:06:31.079030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:06:31.079674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:06:31.079956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:06:31.080230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:06:31.089435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:06:31.091026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75907-77f1-43ab-b1ad-8e6b34ee8ff5 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:06:31.101105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 732/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:06:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:04.214843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6723-fa6c-4909-b2e0-9ef3aa20bdd1 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:04.215518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6723-fa6c-4909-b2e0-9ef3aa20bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:04.215518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c6723-fa6c-4909-b2e0-9ef3aa20bdd1 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:04.216813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 739/1471] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:04.222186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926dfd-94ef-4fc0-906d-41e141e43317 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:04.222644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926dfd-94ef-4fc0-906d-41e141e43317 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:04.222794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926dfd-94ef-4fc0-906d-41e141e43317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:04.241020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4a926dfd-94ef-4fc0-906d-41e141e43317 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:04.242206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4a926dfd-94ef-4fc0-906d-41e141e43317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:04.249985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 733/1472] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:07:04.296717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45285-5c40-46ef-9eca-0a27a20e5107 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:04.297032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45285-5c40-46ef-9eca-0a27a20e5107 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:04.297306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea45285-5c40-46ef-9eca-0a27a20e5107 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:04.298720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 740/1473] 10.222.0.25 () {54 vars in 962 bytes} [Tue May 17 18:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:04.304532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6a8a-8874-4667-b9df-07e2f6451c2a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:04.304827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6a8a-8874-4667-b9df-07e2f6451c2a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:04.305112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d6a8a-8874-4667-b9df-07e2f6451c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:04.323020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ba2d6a8a-8874-4667-b9df-07e2f6451c2a None None] MFA Rules not processed for user `8730a384ede5490eaa8e818e7c60518d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:04.324197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ba2d6a8a-8874-4667-b9df-07e2f6451c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:04.330589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 734/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Tue May 17 18:07:04 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:07:04.339837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea45285-5c40-46ef-9eca-0a27a20e5107 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:04.350961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea45285-5c40-46ef-9eca-0a27a20e5107 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:04.354425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:04.355087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:04.355371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:04.355649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:04.364341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:04.365773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae649c0-987f-47cb-a2fa-c355948aaf07 service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:04.375078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 741/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:06.665764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0655-2cca-446e-8f6b-77049042d5ea None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.666298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0655-2cca-446e-8f6b-77049042d5ea None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.666298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb0655-2cca-446e-8f6b-77049042d5ea None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.667692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 735/1476] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:06.673164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9671f4-4fe3-4e07-93d0-638b17dc7718 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.673613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9671f4-4fe3-4e07-93d0-638b17dc7718 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.673722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9671f4-4fe3-4e07-93d0-638b17dc7718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.691695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-db9671f4-4fe3-4e07-93d0-638b17dc7718 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:06.693477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-db9671f4-4fe3-4e07-93d0-638b17dc7718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:06.701124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 742/1477] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:07:06.723467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb0655-2cca-446e-8f6b-77049042d5ea None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:06.735572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb0655-2cca-446e-8f6b-77049042d5ea None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:06.740546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:06.741302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:06.741587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:06.741864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:06.742624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:06.744351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:07:06.744351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:07:06.744351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:07:06.745496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c999e0-90dc-4436-8e1b-afe4729423b8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:06.764486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 736/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue May 17 18:07:06 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:07:08.991305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e067d-fcd4-41cf-92c7-8c9d1586c8ae None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:08.991818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e067d-fcd4-41cf-92c7-8c9d1586c8ae None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:08.991818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e067d-fcd4-41cf-92c7-8c9d1586c8ae None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:08.993206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 743/1479] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:08.998472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27472ba-b9df-4411-b9d4-fbe98268ff4f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:08.998924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27472ba-b9df-4411-b9d4-fbe98268ff4f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:08.999084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27472ba-b9df-4411-b9d4-fbe98268ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.017689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d27472ba-b9df-4411-b9d4-fbe98268ff4f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:09.018979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d27472ba-b9df-4411-b9d4-fbe98268ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:09.027026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 737/1480] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:07:09.069867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e067d-fcd4-41cf-92c7-8c9d1586c8ae None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:09.084069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e067d-fcd4-41cf-92c7-8c9d1586c8ae None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:09.089390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:09.090026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:09.090308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:09.090611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:09.098494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:09.100259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e499c-9cbe-4b9e-ad74-1f471a2ebcd3 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:09.109977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 744/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:11.492824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fdc8-eae8-409d-aed4-10d21258d5ef None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.493407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fdc8-eae8-409d-aed4-10d21258d5ef None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.493407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8fdc8-eae8-409d-aed4-10d21258d5ef None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.494799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 738/1482] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:11.499949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263abb6-07d7-4ef9-b85e-af334277d882 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.500404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263abb6-07d7-4ef9-b85e-af334277d882 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.500514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263abb6-07d7-4ef9-b85e-af334277d882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.517970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d263abb6-07d7-4ef9-b85e-af334277d882 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:11.519167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d263abb6-07d7-4ef9-b85e-af334277d882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:11.527485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 745/1483] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:07:11.562558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8fdc8-eae8-409d-aed4-10d21258d5ef None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:11.573921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8fdc8-eae8-409d-aed4-10d21258d5ef None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:11.577311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:11.577938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:11.578274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:11.578544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:11.587926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:11.589335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df201d5-bafa-4bfa-9da9-a024efbb53ba service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:11.598293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 739/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:13.936251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377886-1faf-4dc2-b547-18a5c63e73ca None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:13.936730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377886-1faf-4dc2-b547-18a5c63e73ca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:13.936896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d377886-1faf-4dc2-b547-18a5c63e73ca None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:13.938167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 746/1485] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:13.944395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de27d6-b81f-4e36-8536-6c8441d6f7e4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:13.944795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de27d6-b81f-4e36-8536-6c8441d6f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:13.944961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05de27d6-b81f-4e36-8536-6c8441d6f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:13.964216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-05de27d6-b81f-4e36-8536-6c8441d6f7e4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:13.965425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-05de27d6-b81f-4e36-8536-6c8441d6f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:13.973269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 740/1486] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:07:14.014802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d377886-1faf-4dc2-b547-18a5c63e73ca None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:14.023691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d377886-1faf-4dc2-b547-18a5c63e73ca None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:14.027129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:14.027758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:14.028038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:14.028309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:14.037022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:14.038408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22a985-681b-45a6-9a1a-d5e449fc974e service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:14.047407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 747/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:16.414851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2e86f-3a85-4a0f-ab10-ee40db5ee4f1 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:16.415815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2e86f-3a85-4a0f-ab10-ee40db5ee4f1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:16.416077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f2e86f-3a85-4a0f-ab10-ee40db5ee4f1 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:16.417665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 741/1488] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:16.423392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204abf-10a7-4f12-940b-712f47bf7929 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:16.423882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204abf-10a7-4f12-940b-712f47bf7929 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:16.423988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48204abf-10a7-4f12-940b-712f47bf7929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:16.441406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-48204abf-10a7-4f12-940b-712f47bf7929 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:16.442666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-48204abf-10a7-4f12-940b-712f47bf7929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:16.450232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 748/1489] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:07:16.490485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2e86f-3a85-4a0f-ab10-ee40db5ee4f1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:16.500943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f2e86f-3a85-4a0f-ab10-ee40db5ee4f1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:16.504412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:16.505074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:16.505349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:16.505626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:16.514285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:16.515749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2a232-545a-4c44-89d1-ad7b1d9eadc7 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:16.525578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 742/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:07:18.931105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df3ad-4690-42ea-af06-392e6402637a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:18.931585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df3ad-4690-42ea-af06-392e6402637a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:18.931684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8df3ad-4690-42ea-af06-392e6402637a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:18.933044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 749/1491] 10.222.0.25 () {54 vars in 926 bytes} [Tue May 17 18:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:07:18.938513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b5cf-9324-486d-b7ed-bba269963757 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:18.938972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b5cf-9324-486d-b7ed-bba269963757 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:18.939079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481b5cf-9324-486d-b7ed-bba269963757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:18.956875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7481b5cf-9324-486d-b7ed-bba269963757 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:07:18.958633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7481b5cf-9324-486d-b7ed-bba269963757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:07:18.966448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 743/1492] 10.222.0.25 () {58 vars in 1023 bytes} [Tue May 17 18:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:07:19.005326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8df3ad-4690-42ea-af06-392e6402637a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:07:19.015690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8df3ad-4690-42ea-af06-392e6402637a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:07:19.019389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:07:19.020020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:07:19.020985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:07:19.021256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:07:19.029954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:07:19.031389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e546f4a9-4722-4859-802f-77a46cde8890 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:07:19.040786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 750/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:07:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:08:57.724525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.725133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.725133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.743036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:57.744215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:57.751897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 744/1494] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:57.761586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.762090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.762207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.779555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:57.780733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:57.788749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 751/1495] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:57.793170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:57.803158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444ac7f1-aa2e-4eec-88c0-1cb83e10d4c1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:57.807629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:57.808280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.808580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.808840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.809564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:08:57.809870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:57.810910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:57.810910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:08:57.810910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:08:57.811797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:57.823636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 745/1496] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:08:57.831771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:57.840610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fa035-da9f-42df-9d0c-3b8de148339b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:57.845172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:57.845868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.846132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.846395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.847123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:57.848865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:57.848865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:08:57.848865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:08:57.850056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:57.886050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 752/1497] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:08:57.890100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:57.899626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd864e-8e29-4293-93a8-f09449ed5eab admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:57.953233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:57.953896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.954178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.954453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.955232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:57.956566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:57.956566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:08:57.956566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:08:57.957744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:57.977314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 746/1498] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:08:57 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:08:57.981347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:57.991903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816ed0-e7b0-4b73-985d-51040ae25946 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:57.996781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:57.997437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:57.997716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:57.997989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:57.998729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:57.999728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:57.999728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:08:57.999728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:08:58.000589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.012961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 753/1499] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:08:58.017070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:58.026972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e8fae-3f7b-4afd-bbc2-ced0afa5bdf0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.031478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.032132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.032413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.032683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.033986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.035026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:58.035026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:08:58.035026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:08:58.035899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24cd161-2109-4a7b-a5a2-52919560425c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.049539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 747/1500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:08:58.053427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:58.063067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af84b29-df95-4fb8-941e-c2693c7fdb65 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.067788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.068667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.068974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.069240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] PATH_INFO: `/v3/projects/01b8bdd8f6ca48f19d413a0b659c28ed/users/7a3ec48695724c9382ea75afebe7bad9/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.083430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b8bdd8f6ca48f19d413a0b659c28ed, user_id=7a3ec48695724c9382ea75afebe7bad9, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.084445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:58.084445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:08:58.084445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:08:58.086330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21d2fc6-13de-4b1f-85af-44ce49ecb5b2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.099357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 754/1501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:08:58 2022] PUT /identity/v3/projects/01b8bdd8f6ca48f19d413a0b659c28ed/users/7a3ec48695724c9382ea75afebe7bad9/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:08:58.110457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f0ea-94a9-446b-b8c5-15c34990e1c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.110775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f0ea-94a9-446b-b8c5-15c34990e1c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.111054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b82f0ea-94a9-446b-b8c5-15c34990e1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.136602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9b82f0ea-94a9-446b-b8c5-15c34990e1c8 None None] MFA Rules not processed for user `7a3ec48695724c9382ea75afebe7bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:58.137782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9b82f0ea-94a9-446b-b8c5-15c34990e1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:58.198218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 748/1502] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:58.211312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce3bf4-8f6e-4db2-b33e-56036c81ba23 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.211614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce3bf4-8f6e-4db2-b33e-56036c81ba23 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.211884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce3bf4-8f6e-4db2-b33e-56036c81ba23 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.213220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 755/1503] 10.222.0.25 () {54 vars in 963 bytes} [Tue May 17 18:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:58.217922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5234-a979-412e-927f-3b20a720e8f3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.218213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5234-a979-412e-927f-3b20a720e8f3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.218491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5234-a979-412e-927f-3b20a720e8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.237439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-441c5234-a979-412e-927f-3b20a720e8f3 None None] MFA Rules not processed for user `0292f8e2e5ff4fe8939c078d01993ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:58.238527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-441c5234-a979-412e-927f-3b20a720e8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:58.286246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 749/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Tue May 17 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:08:58.293600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce3bf4-8f6e-4db2-b33e-56036c81ba23 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:58.304497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce3bf4-8f6e-4db2-b33e-56036c81ba23 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.307999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.308631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.308913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.309189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.317576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.319020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.327471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 756/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:08:58 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:08:58.369403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cd00-5c6e-4d0a-bc76-db31b148a9c8 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.369691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cd00-5c6e-4d0a-bc76-db31b148a9c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.369971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a3cd00-5c6e-4d0a-bc76-db31b148a9c8 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.371320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 750/1506] 10.222.0.25 () {52 vars in 829 bytes} [Tue May 17 18:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:08:58.374864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:58.434226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fbf294-9c31-47a6-b889-eeea9482b272 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.438787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.439658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.439939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.440214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] PATH_INFO: `/v3/users/7a3ec48695724c9382ea75afebe7bad9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.441657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a3ec48695724c9382ea75afebe7bad9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.442692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:58.442692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:08:58.442692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:08:58.443894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.506015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a3ec48695724c9382ea75afebe7bad9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:58.524265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a3ec48695724c9382ea75afebe7bad9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:58.524937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a3ec48695724c9382ea75afebe7bad9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:58.525634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a3ec48695724c9382ea75afebe7bad9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:58.534979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a3ec48695724c9382ea75afebe7bad9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:58.551817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 757/1507] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:08:58 2022] DELETE /identity/v3/users/7a3ec48695724c9382ea75afebe7bad9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:08:58.556156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.556446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.556726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.573950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:08:58.575188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:58.631329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:08:58.641196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:58.643187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:58.699312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4bfad8-d804-420a-a8ad-9faf4b7aa0a0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:58.702858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:58.703500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:58.703778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:58.704047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:58.713259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:58.714682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8920dd0f-ab7a-46ae-8332-2f60b8ad6f5d service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:58.723635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 758/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:08:59.055534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:08:59.057027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:08:59.069997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de9f2-eafd-4ec9-98ed-fc81f21973b4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:08:59.074675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:08:59.075546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:08:59.075824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:08:59.076097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] PATH_INFO: `/v3/projects/01b8bdd8f6ca48f19d413a0b659c28ed` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:08:59.077264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b8bdd8f6ca48f19d413a0b659c28ed)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:08:59.078276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:08:59.078276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:08:59.078276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:08:59.079617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:08:59.152858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b8bdd8f6ca48f19d413a0b659c28ed', 'request_id': 'req-85ba581d-a554-48a5-b95c-fea92aa69480'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:59.159297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b8bdd8f6ca48f19d413a0b659c28ed', 'request_id': 'req-85ba581d-a554-48a5-b95c-fea92aa69480'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:59.168835 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b8bdd8f6ca48f19d413a0b659c28ed', 'request_id': 'req-85ba581d-a554-48a5-b95c-fea92aa69480'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:59.195786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] The token cache is being invalidate because project 01b8bdd8f6ca48f19d413a0b659c28ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:08:59.196080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:59.196896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-85ba581d-a554-48a5-b95c-fea92aa69480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:08:59.198511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 752/1510] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:08:59 2022] DELETE /identity/v3/projects/01b8bdd8f6ca48f19d413a0b659c28ed => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:10:39.913140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:39.913713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:39.913846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:39.915170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:10:39.920197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf544fd-7b28-4144-a796-cf6b2660d468 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:39.921211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf544fd-7b28-4144-a796-cf6b2660d468 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:39.921859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf544fd-7b28-4144-a796-cf6b2660d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:39.940482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fbf544fd-7b28-4144-a796-cf6b2660d468 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:39.941707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fbf544fd-7b28-4144-a796-cf6b2660d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:39.998864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:40.178887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:40.180525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:40.253039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89cc32-b339-41f0-ade8-43f993fb4d9d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:40.258454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:40.259142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.259428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.259708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.268020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:40.269604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92274-8bfd-4624-bca1-f65a2ded1de8 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:40.279369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 760/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:40.953394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77c-eff9-475b-aaf3-5de2f71180a3 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.953944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77c-eff9-475b-aaf3-5de2f71180a3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.953944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dae77c-eff9-475b-aaf3-5de2f71180a3 None None] PATH_INFO: `/v3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.955279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 754/1514] 10.222.0.64 () {54 vars in 925 bytes} [Tue May 17 18:10:40 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:10:40.964131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d8542-c718-4a0e-93b9-28bca6a1e5bc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:40.964550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d8542-c718-4a0e-93b9-28bca6a1e5bc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:40.964728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d8542-c718-4a0e-93b9-28bca6a1e5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:40.984165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-841d8542-c718-4a0e-93b9-28bca6a1e5bc None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:40.985336 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-841d8542-c718-4a0e-93b9-28bca6a1e5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:41.046158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 761/1515] 10.222.0.64 () {58 vars in 1015 bytes} [Tue May 17 18:10:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:41.188493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735f2e-d834-4c71-9829-317eb73b7c9b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.188808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735f2e-d834-4c71-9829-317eb73b7c9b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.189155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10735f2e-d834-4c71-9829-317eb73b7c9b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.190565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 755/1516] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:10:41.195565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286d27-b85f-4855-9e54-6b012036bb2c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.195865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286d27-b85f-4855-9e54-6b012036bb2c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.196147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08286d27-b85f-4855-9e54-6b012036bb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.214226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-08286d27-b85f-4855-9e54-6b012036bb2c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:41.215446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-08286d27-b85f-4855-9e54-6b012036bb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:41.223471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 762/1517] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:41.375043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10735f2e-d834-4c71-9829-317eb73b7c9b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:41.388957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10735f2e-d834-4c71-9829-317eb73b7c9b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:41.394644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:41.395283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:41.395564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:41.395838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:41.403879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:41.405577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537a0a-9a17-4472-bebf-ea0c57f7c65a service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:41.414697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 756/1518] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:10:44.926949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c875-abc2-49f8-a80e-57c7958ff31b None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.927426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c875-abc2-49f8-a80e-57c7958ff31b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.927530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1c875-abc2-49f8-a80e-57c7958ff31b None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:44.928885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 763/1519] 10.222.0.25 () {54 vars in 960 bytes} [Tue May 17 18:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:44.933959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e513-6e30-4d9d-bbd4-ad0162c6c54c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.934425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e513-6e30-4d9d-bbd4-ad0162c6c54c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.934535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924e513-6e30-4d9d-bbd4-ad0162c6c54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:44.953969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6924e513-6e30-4d9d-bbd4-ad0162c6c54c None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:44.955208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6924e513-6e30-4d9d-bbd4-ad0162c6c54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:44.963554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 757/1520] 10.222.0.25 () {58 vars in 1057 bytes} [Tue May 17 18:10:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:10:44.972890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c875-abc2-49f8-a80e-57c7958ff31b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:44.986061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1c875-abc2-49f8-a80e-57c7958ff31b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:44.990905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:44.991540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:44.991824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:44.992099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:45.000068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:45.001624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7712-38d3-403e-8f35-23c8e0e49c78 service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:45.010906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 764/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:52.714323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e820-cfed-4585-9663-e1fca7a4e94a None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.714904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e820-cfed-4585-9663-e1fca7a4e94a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.714904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96e820-cfed-4585-9663-e1fca7a4e94a None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.716292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:52.721746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1de5f-aa1f-4b29-93d0-cd0c9b08e470 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.722205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1de5f-aa1f-4b29-93d0-cd0c9b08e470 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.722315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1de5f-aa1f-4b29-93d0-cd0c9b08e470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.740173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a7a1de5f-aa1f-4b29-93d0-cd0c9b08e470 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:52.741383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a7a1de5f-aa1f-4b29-93d0-cd0c9b08e470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:52.749125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:52.900097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e820-cfed-4585-9663-e1fca7a4e94a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:52.915338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96e820-cfed-4585-9663-e1fca7a4e94a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:52.921162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:52.921805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:52.922085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:52.922355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:52.930786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:52.932383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b5b8c-e95a-4309-91ee-21669e54e956 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:52.942410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 759/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:53.829562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e993e-a780-49dd-8393-9808b2bc25bf None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:53.830154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e993e-a780-49dd-8393-9808b2bc25bf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:53.830154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e993e-a780-49dd-8393-9808b2bc25bf None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:53.831535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue May 17 18:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:53.836583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca85e-85e7-4dbe-9025-900982d4a681 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:53.837025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca85e-85e7-4dbe-9025-900982d4a681 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:53.837124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ca85e-85e7-4dbe-9025-900982d4a681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:53.855162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a72ca85e-85e7-4dbe-9025-900982d4a681 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:53.856348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a72ca85e-85e7-4dbe-9025-900982d4a681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:53.864259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue May 17 18:10:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:54.014442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e993e-a780-49dd-8393-9808b2bc25bf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:54.028573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e993e-a780-49dd-8393-9808b2bc25bf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:54.034531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:54.035200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:54.035485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:54.035762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:54.043657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:54.045230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46c21ba-7e07-4491-8be5-3b19a291cd08 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:54.054470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 767/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:10:57.937121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:57.937650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:57.937756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:57.939154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:10:57.944724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad0-c8e5-43fe-b89e-63571c961c1c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:57.945140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad0-c8e5-43fe-b89e-63571c961c1c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:57.945280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948dad0-c8e5-43fe-b89e-63571c961c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:57.964188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4948dad0-c8e5-43fe-b89e-63571c961c1c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:10:57.965387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4948dad0-c8e5-43fe-b89e-63571c961c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:57.974239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:10:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:10:58.010450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:10:58.012134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:10:58.067640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e627aa77-e8b9-4e6c-ba13-d4dab3c313c4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:10:58.071385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:10:58.072036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:10:58.072323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:10:58.072604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:10:58.082252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:10:58.083713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49484a85-2fe0-4758-86fc-36a368e80508 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:10:58.092882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 762/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:00.286186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda45a5-7a54-41d3-8539-546f3e67ea8a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:00.286796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda45a5-7a54-41d3-8539-546f3e67ea8a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:00.286796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda45a5-7a54-41d3-8539-546f3e67ea8a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:00.288124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:00.293388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2d99-be59-4670-8799-c8899ec43dd9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:00.293803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2d99-be59-4670-8799-c8899ec43dd9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:00.293981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2d99-be59-4670-8799-c8899ec43dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:00.312483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d4fb2d99-be59-4670-8799-c8899ec43dd9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:00.313664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d4fb2d99-be59-4670-8799-c8899ec43dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:00.321645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:00.357206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda45a5-7a54-41d3-8539-546f3e67ea8a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:00.367964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda45a5-7a54-41d3-8539-546f3e67ea8a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:00.371580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:00.372221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:00.372505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:00.372784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:00.382134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:00.383586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1faa8d8-0d97-480c-b0d0-bff2c1ef30e7 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:00.393434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 770/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:11:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:04.021386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.021955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.021955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.023373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:04.028655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7d57-b12b-447c-a58b-019e0fc87a4c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.029570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7d57-b12b-447c-a58b-019e0fc87a4c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.029734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7d57-b12b-447c-a58b-019e0fc87a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.047909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f7ca7d57-b12b-447c-a58b-019e0fc87a4c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:04.049071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f7ca7d57-b12b-447c-a58b-019e0fc87a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:04.056736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:04.328447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:04.330115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:04.384969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567abd1e-3e2c-485f-8a38-ea41ada0760f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:04.388942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:04.389602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:04.389887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:04.390165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:04.398794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:04.400223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292dc0a9-0041-4b75-9b15-a1ef467e14d7 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:04.409784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 765/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:11:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:11:06.648980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.649551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.649551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.650958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue May 17 18:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:11:06.656209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca7dc-f21d-4ec8-b5b4-e9064db0ccf9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.656639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca7dc-f21d-4ec8-b5b4-e9064db0ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.656746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ca7dc-f21d-4ec8-b5b4-e9064db0ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.675078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3f7ca7dc-f21d-4ec8-b5b4-e9064db0ccf9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:11:06.676251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3f7ca7dc-f21d-4ec8-b5b4-e9064db0ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:06.683895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue May 17 18:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:11:06.952850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:11:06.954510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:11:06.967640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa96da0-af19-4866-bf19-7586c67154d3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:11:06.971249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:11:06.971895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:11:06.972176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:11:06.972450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:11:06.981475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:11:06.983533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f370ea-9151-4e15-91e1-96fe736127f3 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:11:06.992684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 773/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:37.225486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.226113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.226113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.257506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.258734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.273378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 767/1540] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.285203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.285798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.285798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.312059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.313272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.327209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 774/1541] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.340919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.358237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514725c-43de-439b-9b08-cdbaffe681c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.367427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.368179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.368468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.368741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.369478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:37.370536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.372266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.392105 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 768/1542] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:37.402503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.412476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3b4ab9-e7e0-417b-a98e-41eda120ad44 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.423317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.424006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.424288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.424565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.425276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.427228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2248d84-cb21-4c27-86bc-21838dd2413c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.472310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 775/1543] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/projects => generated 389 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:12:37.476911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.494430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808fc70c-0923-4fac-90d6-7e6ac8fe2bb7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.537638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6141-242c-4dd2-bb3b-4775e7750cd2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.538011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6141-242c-4dd2-bb3b-4775e7750cd2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.538201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267b6141-242c-4dd2-bb3b-4775e7750cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.571183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-267b6141-242c-4dd2-bb3b-4775e7750cd2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.572564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-267b6141-242c-4dd2-bb3b-4775e7750cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.587675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.588634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.588818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.589031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.589727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.591765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.630758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 769/1544] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:37.637257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.652981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f494fa-0a31-4f4a-b25a-62f8da440408 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.665193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.665899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.666190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.667070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.667831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.669671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.676341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 776/1545] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:37.687360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.687714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.687923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.689133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 770/1546] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:37.693376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.709730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bd80c-aaad-4a96-8374-1da8498c37d6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.718132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.718853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.719188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.719474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.720256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.721920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c75d22-2f0b-470e-9404-611ca26fb3a0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.725203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.726021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.742145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 771/1547] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:12:37.743419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.743706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.743981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.746621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 777/1548] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.751417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.767309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5416c8d-8b05-48fb-ba74-121b7b3c9d71 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.776390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.777828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.780559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.781497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.781778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.782051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] PATH_INFO: `/v3/projects/492389142d804ad392267cb4a728008d/users/8ba97b67ecf64476a630fd3667d617fb/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.799289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492389142d804ad392267cb4a728008d, user_id=8ba97b67ecf64476a630fd3667d617fb, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.800542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 772/1549] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.801434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:37.807651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e834ccfb-0762-43cf-a9ab-94bec0526a58 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.826915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a39d8a1-b965-4b9c-853e-632abab3d4be None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:37.831194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 778/1550] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:37 2022] PUT /identity/v3/projects/492389142d804ad392267cb4a728008d/users/8ba97b67ecf64476a630fd3667d617fb/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:37.832345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4a63-143e-44e2-8016-52523260a68b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.832638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4a63-143e-44e2-8016-52523260a68b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.832914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf4a63-143e-44e2-8016-52523260a68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.874158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dabf4a63-143e-44e2-8016-52523260a68b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.875524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dabf4a63-143e-44e2-8016-52523260a68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.930426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:37.930926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.931208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.931732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.932342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:37.932621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:37.934194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9fb730-fcce-47bb-9ad3-e4e083a25a69 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:37.947006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 773/1551] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:37.948156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e136b5-9d14-464f-9c71-8e2515289a88 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.948442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e136b5-9d14-464f-9c71-8e2515289a88 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.948716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e136b5-9d14-464f-9c71-8e2515289a88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.960775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 779/1552] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.962770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873416ea-22e6-42db-b7c0-8846c1860938 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.963064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873416ea-22e6-42db-b7c0-8846c1860938 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.963902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873416ea-22e6-42db-b7c0-8846c1860938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.971282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-98e136b5-9d14-464f-9c71-8e2515289a88 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.972477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-98e136b5-9d14-464f-9c71-8e2515289a88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.981155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 774/1553] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.982399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d89012-962b-407a-b285-5edbb233cdac None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.982715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d89012-962b-407a-b285-5edbb233cdac None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.982991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d89012-962b-407a-b285-5edbb233cdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:37.985661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-873416ea-22e6-42db-b7c0-8846c1860938 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:37.986872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-873416ea-22e6-42db-b7c0-8846c1860938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:37.995880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 780/1554] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:37.996903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847f2a-9af0-4701-bbbb-f50b96fd5256 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:37.997193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847f2a-9af0-4701-bbbb-f50b96fd5256 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:37.997470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8847f2a-9af0-4701-bbbb-f50b96fd5256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.006786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-65d89012-962b-407a-b285-5edbb233cdac None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.007679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-65d89012-962b-407a-b285-5edbb233cdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.015746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b8847f2a-9af0-4701-bbbb-f50b96fd5256 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.016893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b8847f2a-9af0-4701-bbbb-f50b96fd5256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.017028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 775/1555] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.019336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6967-d92f-4603-9a7f-6c72baf06438 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.019719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6967-d92f-4603-9a7f-6c72baf06438 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.020057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f6967-d92f-4603-9a7f-6c72baf06438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.025011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 781/1556] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.026492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.026654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.026840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.044428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-603f6967-d92f-4603-9a7f-6c72baf06438 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.044668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.045621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.045748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-603f6967-d92f-4603-9a7f-6c72baf06438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.053581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 782/1557] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.053816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 776/1558] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.054318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.055645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.056084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.056501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.064872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f58ab-ce29-4ba9-8eab-5df393b289c0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.069688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.070343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.070653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.070928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.071611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.074156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.079480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.080645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.088412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 777/1559] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.089333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.098425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fa52f-93e4-45ec-92bb-9878946b43dc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.100971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 783/1560] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.102127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.103124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.103769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.104680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.105024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.105725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.106027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.106170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.107631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a658473-f898-4d80-a88d-b77b9ad57e1b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.128166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 778/1561] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.128166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1cdd-89c1-4f05-9039-5036fa844784 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.128166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1cdd-89c1-4f05-9039-5036fa844784 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.128166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ad1cdd-89c1-4f05-9039-5036fa844784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.140614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c0ad1cdd-89c1-4f05-9039-5036fa844784 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.141783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c0ad1cdd-89c1-4f05-9039-5036fa844784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.165372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf40fa5-8b5f-4485-80f3-043d6efa4d53 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.170036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.170723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.171011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.171290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.197777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 779/1562] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.199501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f5e6-91e9-4750-b15c-8d6f85a07a26 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.199891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f5e6-91e9-4750-b15c-8d6f85a07a26 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.200269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14f5e6-91e9-4750-b15c-8d6f85a07a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.217323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7c14f5e6-91e9-4750-b15c-8d6f85a07a26 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.218491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7c14f5e6-91e9-4750-b15c-8d6f85a07a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.226729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 780/1563] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.227922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.228206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.228480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.232910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.234310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177c908-68b5-4475-9fcc-c0c126dd4619 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.243969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 784/1564] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:38.245865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.246210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.246439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.247544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.248704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.257543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 781/1565] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.258209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.267939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d2fe4a-50b1-4e4f-b330-3f86fd9acd96 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.268379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:38.269585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:38.273232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.274340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.274787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.275240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.276371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.276829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.282150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.282319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 785/1566] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:38.282319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.288792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af2226-238a-450b-9240-c7f0c4d60f0a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.301969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 782/1567] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.302182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.302182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.302374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:12:38.302468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.313587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3821d2-2cb0-4e3e-a9d5-34ec11db20ff admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.320141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.320942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.321234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.321503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.322204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.324031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:38.324031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:12:38.324031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:12:38.324656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.328522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 786/1568] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/users => generated 293 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.329979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.344043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc8a6f-4048-461a-8351-6563ba7ffb18 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.349706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.350374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.350692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.350970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.351681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.351990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.353075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:38.353075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:12:38.353075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:12:38.354469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.361453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 783/1569] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 393 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.361453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.367666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 787/1570] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.368777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.381206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ab5d-1acd-43d5-89b6-6e50d861ec7d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.443426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5d58a-3f01-41d4-bfd8-231d12a8eb3e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.449918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.450905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.451214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.451673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.452558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.452974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.453677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.454478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.454628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.454958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.455397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.456596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.457596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.459637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.466722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 784/1571] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.467586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.474516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 788/1572] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.475772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.477464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20520595-698e-4ae1-ba86-0cdcf5c54635 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.484271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.485066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.485357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.485633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.486354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:38.486690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.487812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4697b0-b6e1-4caf-8734-5625af6330fc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.488294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.494090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.495524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.495868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.496279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.497196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.498962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.511798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 785/1573] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:38.511798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.518670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e8ded6-8af5-4d08-9875-8bb6d6b2587b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.524127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.524961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.525243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.525517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.526275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.530304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 789/1574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.530304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.530943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.542847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 786/1575] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:38.542847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.552462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5cf03-e5a3-411d-bb37-80ca499a3464 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.609622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931ce5-4c93-4155-971e-ff85fdb7a7de admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.615297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.616145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.616735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.617265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.617974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.620584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.625656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.626604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.626951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.627336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.628109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.630163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.645298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 790/1576] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.646131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.658824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91cfcc-c80b-4f15-9794-8746dcdea1d8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.663955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.664675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.664962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.665237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.665915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 787/1577] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 393 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.666983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.669287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.671319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.708142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 791/1578] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.709116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.739885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e49a86f-6394-4fb7-b1fa-c97cde2b6496 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.775966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136920cb-ea2b-4a8d-9519-a0d086b1aa71 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.780633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.781348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.781634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.781917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.782621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.784549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.801145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.801847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.802138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.802532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.803251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.805336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.813048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 792/1579] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.813856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.838496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 788/1580] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/projects => generated 385 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.839230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.882372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d5b9-de4f-4bfc-afda-435b2fbf0c4a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.912087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb0333-18fb-4d14-b5c6-cdcb5bb5d645 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.917824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.921995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.921995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.921995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.921995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.924653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.938958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 789/1581] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:38.939858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.950309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a4691-a6cb-47a1-9cfb-acd63b0d318c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:38.953730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.954980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.955266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.955573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.956364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.958707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.961159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:38.961853 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:38.962138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:38.962412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:38.966361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:38.966361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:38.982624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 790/1582] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:38.982624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.991488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 793/1583] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:38.992502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:38.994762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e626df41-890e-430a-b5bd-14b008a91aea admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.000435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.001353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.001642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.001921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.002808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.004743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.006866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189c0ae-c066-4a24-8c67-74154a132ea5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.014622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.015042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.015369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.015645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.016384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.018757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.029623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 791/1584] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:39.030555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.040848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77de7cb-16cc-47f5-ae3c-41ae966c74d6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.049876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 794/1585] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:38 2022] POST /identity/v3/users => generated 286 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:39.050100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.050220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.050328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.050328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.050328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.050328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.052386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.061099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816d749-1893-4fd8-b115-5361fe7d0f03 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.068523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.069478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.069859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.070257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.071130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.074085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.082831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 792/1586] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:39 2022] POST /identity/v3/users => generated 289 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:39.083851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.099260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a80b6-0982-485e-83a9-d787876baa23 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.100824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 795/1587] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:39 2022] POST /identity/v3/users => generated 293 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:39.101612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.111068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.112057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.112375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.112771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] PATH_INFO: `/v3/projects/4475ac01e59d43438b45bc5fc01fb00b/users/c7b641ce301a4b7685f0f70d7ac4a5d3/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.114664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c8303c-76b0-43f4-814e-82d1bea119cc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.120050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.121269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.121648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.122018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.122915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.124611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.129734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4475ac01e59d43438b45bc5fc01fb00b, user_id=c7b641ce301a4b7685f0f70d7ac4a5d3, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.130962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:39.130962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:12:39.130962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:12:39.132869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.137448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 796/1588] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.139727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.151926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f084b-9015-4adc-a88c-0ca3bc5377f6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.154982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 793/1589] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/4475ac01e59d43438b45bc5fc01fb00b/users/c7b641ce301a4b7685f0f70d7ac4a5d3/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.157586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.222925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.223619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.223904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.224180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.224919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.226812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.238916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 797/1590] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.239787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.247191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fcc871-ffec-4822-87b7-301d79ae92dc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.250095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef0533f-6a5a-4ee0-bd1b-5451850c866f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.253940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.255097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.255427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.255852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.256109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.256391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.256669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.257032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.257399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.258363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.259060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.260652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.270330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 798/1591] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.271118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.273719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 794/1592] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.274877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.282162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661e8b0-014c-4237-908c-568e601d5d1d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.286972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474a60f-00e5-484b-b959-a32fb98671f9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.287324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.288007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.288294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.288667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.289408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.291188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.294680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.295631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.296145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.296628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.297570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.299626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a9f3c-925c-47af-9017-068c0392793e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.305663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 799/1593] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.305663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.315132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 795/1594] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.316529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91099e3-a0bb-4f31-a6b8-8dec08a56d4e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.316909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.317555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.317958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.322097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.323119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.323402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.323678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] PATH_INFO: `/v3/projects/e32e7b68f0464827afc5ed835cee1d15/users/62a9f27a865b468989f672a05dbab350/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.339318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32e7b68f0464827afc5ed835cee1d15, user_id=62a9f27a865b468989f672a05dbab350, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.341472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:39.341980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.343035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:39.354544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 796/1595] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:39.355566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.365869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9512ea3-84cf-4100-af5d-56d0e500b14d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.374772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 800/1596] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/e32e7b68f0464827afc5ed835cee1d15/users/62a9f27a865b468989f672a05dbab350/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.374772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.440710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.441759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.442919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.443366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.444251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.446079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.454388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5018da92-655a-440f-a85e-d5930baf6d30 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.458754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 797/1597] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.459693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.459955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.460830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.461209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.461586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.462420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.465340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.475050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e28b62-2fb1-4420-ad90-40792f856860 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.480033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 801/1598] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.480033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.486384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.487356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.488470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0908ff-85c3-480a-b933-e47200ff1505 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.488653 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.488945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.489679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.492403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.495103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.496129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.496511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.497503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.498344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.500246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.511451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 802/1599] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.512383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.518180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 798/1600] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.518180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.524692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68944de-4f4a-4fd0-9d05-c33df2fc1017 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.529595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.530267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.530547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.530868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.531632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.533289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f50d368-a1ad-469b-855b-bb8552b74550 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.552213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 803/1601] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:39.553624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.554182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.554618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.581216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:39.584782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:39.596034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212c620-9f3e-4692-873f-866725364cb0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.600404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.601260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.601614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.601964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.602762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 804/1602] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:39.603641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.613273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.615091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.615620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a834c7a-4d61-42c9-9717-6c66844dc4b0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.622498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.623557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.623838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.624163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] PATH_INFO: `/v3/projects/c087a662f09843faa87b942c9462ec67/users/17c2097983df461eb7c23bc0ed7b7520/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.626446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 799/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:39.627416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.643014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6610064-1e68-4856-af93-a4abc89ddd05 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.647025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c087a662f09843faa87b942c9462ec67, user_id=17c2097983df461eb7c23bc0ed7b7520, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.648633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.649967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.650355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.650474 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.651301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] PATH_INFO: `/v3/projects/69fb47a4ee9d4f03b6d1bd55075af2fd/users/a502437b0aa84ee0afc7a1d9a637e0c7/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.669525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 805/1604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/c087a662f09843faa87b942c9462ec67/users/17c2097983df461eb7c23bc0ed7b7520/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.670793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.675549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69fb47a4ee9d4f03b6d1bd55075af2fd, user_id=a502437b0aa84ee0afc7a1d9a637e0c7, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.680690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.717704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 800/1605] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/69fb47a4ee9d4f03b6d1bd55075af2fd/users/a502437b0aa84ee0afc7a1d9a637e0c7/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.718701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.768577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed3f73-c6be-4ec4-93a5-e998a3dcf0f0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.862553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c45830-4280-41c7-85c2-9a4880151631 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:39.872474 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.873509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.873646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.873918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] PATH_INFO: `/v3/projects/3e1803826fca42f686f47bd2032828b1/users/c520132de15345be9472b792965323a3/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.888185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:39.891049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:39.891280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e1803826fca42f686f47bd2032828b1, user_id=c520132de15345be9472b792965323a3, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.891774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:39.892684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] PATH_INFO: `/v3/projects/6bd19a1a4e6e40629d90609e92b37e66/users/63dd586a18634b64ab482b6b33c374e4/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:39.893815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.912635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 806/1606] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/3e1803826fca42f686f47bd2032828b1/users/c520132de15345be9472b792965323a3/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.914238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:39.921089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd19a1a4e6e40629d90609e92b37e66, user_id=63dd586a18634b64ab482b6b33c374e4, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:39.924246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:39.955862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 801/1607] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/6bd19a1a4e6e40629d90609e92b37e66/users/63dd586a18634b64ab482b6b33c374e4/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:39.955862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.017822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344721c5-79bc-4230-8105-4eb6ff356035 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.045169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff1004a-8684-4413-870d-03fa1362b686 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.050054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.056056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.056056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.056056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.100234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.101195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.101477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.101757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] PATH_INFO: `/v3/projects/4c4fcce854e14091939e4f379f438762/users/c2b0f1d86c5a4cdeb5b0f9da35dcae8f/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.118599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c4fcce854e14091939e4f379f438762, user_id=c2b0f1d86c5a4cdeb5b0f9da35dcae8f, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:40.122897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fd4635-b4a7-4662-b981-6ec6758e7978 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:40.151813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:40.153424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689baa73-8a0f-479d-9022-8ec6d075aa89 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:40.170079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 802/1608] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:40.171055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 807/1609] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:39 2022] PUT /identity/v3/projects/4c4fcce854e14091939e4f379f438762/users/c2b0f1d86c5a4cdeb5b0f9da35dcae8f/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:40.172034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f9ec-663b-42f3-8f17-552189b2f289 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.172387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f9ec-663b-42f3-8f17-552189b2f289 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.172754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f4f9ec-663b-42f3-8f17-552189b2f289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.173722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20260-6cea-4646-8bdd-302e5781b8e7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.176798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20260-6cea-4646-8bdd-302e5781b8e7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.176798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f20260-6cea-4646-8bdd-302e5781b8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.198301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-57f4f9ec-663b-42f3-8f17-552189b2f289 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.203057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-57f4f9ec-663b-42f3-8f17-552189b2f289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.248540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-98f20260-6cea-4646-8bdd-302e5781b8e7 None None] MFA Rules not processed for user `a502437b0aa84ee0afc7a1d9a637e0c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.251247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-98f20260-6cea-4646-8bdd-302e5781b8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.295976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 803/1610] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.297315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cca03b-a249-495d-9ea4-e9a06ef30eaa None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.297609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cca03b-a249-495d-9ea4-e9a06ef30eaa None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.297897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cca03b-a249-495d-9ea4-e9a06ef30eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.340291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c8cca03b-a249-495d-9ea4-e9a06ef30eaa None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.348422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c8cca03b-a249-495d-9ea4-e9a06ef30eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.363816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 804/1611] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.363816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.365197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.365197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.380909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 808/1612] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.382294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.382604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.382898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.408078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] MFA Rules not processed for user `63dd586a18634b64ab482b6b33c374e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.409635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.449285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] MFA Rules not processed for user `c2b0f1d86c5a4cdeb5b0f9da35dcae8f`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.450756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.505371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 805/1613] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.510684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.527771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 809/1614] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.528728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.591980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa68d9-f8cb-417c-9e55-e0323ec2ff86 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.596744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.597505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.597889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.598348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.611266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:40.612964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bc3f8-ee33-4f95-9268-d1067f307bda service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:40.624021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8d71d-101f-4d10-b4df-65cbf0942ab3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.634000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.634704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.634986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.635858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.637241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 806/1615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:40.638852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7c8c-ebae-4e5c-9dbd-729a5612af5b None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.639537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7c8c-ebae-4e5c-9dbd-729a5612af5b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.640017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffa7c8c-ebae-4e5c-9dbd-729a5612af5b None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.641920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 807/1616] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 17 18:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:12:40.642770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7c8c-ebae-4e5c-9dbd-729a5612af5b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.659239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffa7c8c-ebae-4e5c-9dbd-729a5612af5b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.661676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:40.663394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888781b0-648d-43ec-9265-de22f4e3da65 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:40.672298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.674444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.676063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 810/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:40.676385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.676983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.677887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:40.678033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c85-a538-454b-8b70-cabf620224da None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.678385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c85-a538-454b-8b70-cabf620224da None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.678783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c3c85-a538-454b-8b70-cabf620224da None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.681039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 811/1618] 10.222.0.25 () {54 vars in 961 bytes} [Tue May 17 18:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:12:40.682811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df6988-919f-4f9a-93e5-e8dee5c66e03 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:40.683449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.684425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.684803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.720889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.722625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.733741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 808/1619] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/projects => generated 391 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:40.735155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.735436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.735717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:40.758264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:40.759868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:40.871339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 812/1620] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.873230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.890941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 809/1621] 10.222.0.25 () {58 vars in 1058 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:40.892277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:40.898241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc00c3-2a3b-40d4-83db-019e6920aaa7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.909334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cf40a-0ea1-409a-b55b-fbac4c78b5c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:40.920454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:40.921341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:40.925433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:40.925825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.030068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.032464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.049983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 810/1622] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:41.051190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.051448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.052145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.052426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.052695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.056655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.059361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.066733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580a1b5-f187-4bd5-bda2-4ca258e7f0a8 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.075496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.076276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.076625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.077530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.105202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 813/1623] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:40 2022] POST /identity/v3/users => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:41.109498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.132251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556108-af3f-471b-971a-420e1f66952c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.155214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.156782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.157103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.157378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.159454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.164110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.191301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.195585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.207190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 814/1624] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:41.209390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.223462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 811/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:41.245389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fdbdcd-69aa-4649-9f6d-f3071b674281 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.267218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.268714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.269000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.269277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] PATH_INFO: `/v3/projects/788a21ae115d46e08969bbfc883ea659/users/7f652af4c53c4af48c07ee9451595d1c/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.300161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=788a21ae115d46e08969bbfc883ea659, user_id=7f652af4c53c4af48c07ee9451595d1c, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.302853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb526e6-5c70-479f-ae18-ddaeb3645063 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.333144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 815/1626] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:41 2022] PUT /identity/v3/projects/788a21ae115d46e08969bbfc883ea659/users/7f652af4c53c4af48c07ee9451595d1c/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:41.334753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.354161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68707e72-e12b-475c-970b-04e54ca70d63 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.506379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcaa98-2c3b-4689-814c-98f9693a5866 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.506911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcaa98-2c3b-4689-814c-98f9693a5866 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.507026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcaa98-2c3b-4689-814c-98f9693a5866 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.509712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 816/1627] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 17 18:12:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:12:41.525080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.525383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.525694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.531572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.533017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.533326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.533868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.535031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.536655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.569735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 812/1628] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:41 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:41.570732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:41.571210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.572100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:41.590643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343aa1af-f6f1-4ef9-b843-500bcd17fa5e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.606421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.607386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.607673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.608637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] PATH_INFO: `/v3/projects/788a21ae115d46e08969bbfc883ea659/users/7f652af4c53c4af48c07ee9451595d1c/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.614101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=788a21ae115d46e08969bbfc883ea659, user_id=7f652af4c53c4af48c07ee9451595d1c, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.616798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb65c2e-8287-414c-a753-711688f76d9b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.659070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 813/1629] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:41 2022] PUT /identity/v3/projects/788a21ae115d46e08969bbfc883ea659/users/7f652af4c53c4af48c07ee9451595d1c/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:12:41.661046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e412db-3f39-4f90-b9c6-52b2cb0dd1a8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.661337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e412db-3f39-4f90-b9c6-52b2cb0dd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.661617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e412db-3f39-4f90-b9c6-52b2cb0dd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.688843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 817/1630] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:41.700334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.723576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-87e412db-3f39-4f90-b9c6-52b2cb0dd1a8 None None] MFA Rules not processed for user `7f652af4c53c4af48c07ee9451595d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:41.724827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-87e412db-3f39-4f90-b9c6-52b2cb0dd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:41.762488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc4d79-0d4f-4d3d-9ede-2338db600f43 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.820880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.821912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.822307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.823716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.923626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 814/1631] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:41.935991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52f25-4594-4478-bde0-ebc89876773c None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.936386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52f25-4594-4478-bde0-ebc89876773c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.936678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa52f25-4594-4478-bde0-ebc89876773c None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.940808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:41.942658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30625ce-68ac-4410-ab7b-c3fc783a016f service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:41.947264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 815/1632] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 17 18:12:41 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:12:41.948517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52f25-4594-4478-bde0-ebc89876773c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:41.955033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 818/1633] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:41.970464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.971099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.971305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa52f25-4594-4478-bde0-ebc89876773c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:41.971852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:41.982988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:41.983673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:41.983965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:41.988342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:42.021513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:42.024034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:42.026566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:42.031074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:42.061182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 816/1634] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:41 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:42.072343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 819/1635] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:12:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:42.207850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:42.222052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee73d9-2a56-4321-aa2a-7289160d5e3e service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:42.241898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:42.248069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:42.248508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:42.248885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:42.290984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:42.292632 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7cecf-e69e-47b5-9518-51487b8cf39d service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:42.357641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 817/1636] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:43.240402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:43.255629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc910569-1fd7-4b80-8526-70f667c9d2f2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:43.269656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:43.272463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:43.273294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:43.273818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:43.458664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:43.464844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e03413-3886-4b4d-b53b-5ab404e5c9cf service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:43.489116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 820/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:43.621819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:43.622300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:43.622392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:43.723689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] MFA Rules not processed for user `c520132de15345be9472b792965323a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:43.728261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:43.945976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 818/1638] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:43.958108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb5bc-38a2-43b1-bcf1-58584f9ab194 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:43.958395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb5bc-38a2-43b1-bcf1-58584f9ab194 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:43.958698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcb5bc-38a2-43b1-bcf1-58584f9ab194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:43.989251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5abcb5bc-38a2-43b1-bcf1-58584f9ab194 None None] MFA Rules not processed for user `c520132de15345be9472b792965323a3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:43.991260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5abcb5bc-38a2-43b1-bcf1-58584f9ab194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:44.003913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 821/1639] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:44.015919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:44.063569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4c73c9-d963-44ff-8b8a-bc215841688f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:44.073721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:44.074456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:44.074783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:44.075584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:44.086881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:44.089702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b80d0-8b30-4000-afb2-98d6c6abe755 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:44.101799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 819/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:45.845421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131ab6-692e-44d7-b8e5-15646383fba5 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:45.848842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131ab6-692e-44d7-b8e5-15646383fba5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:45.849611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71131ab6-692e-44d7-b8e5-15646383fba5 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:45.853384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 822/1641] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 17 18:12:45 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:12:45.860293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11639b-b71b-4e93-9b77-552595afff12 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:45.860927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11639b-b71b-4e93-9b77-552595afff12 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:45.860927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11639b-b71b-4e93-9b77-552595afff12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:45.997903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7d11639b-b71b-4e93-9b77-552595afff12 None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:45.999883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d11639b-b71b-4e93-9b77-552595afff12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:46.162164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 820/1642] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:12:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:46.270487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131ab6-692e-44d7-b8e5-15646383fba5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:46.290891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71131ab6-692e-44d7-b8e5-15646383fba5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:46.305959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:46.312251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:46.312615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:46.317102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:46.345173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:46.347685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2a0f39-b82f-4c81-908e-2db4f35e8de1 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:46.381011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 823/1643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:48.301406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733893-4813-4b7b-96ea-c646f766d6f2 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:48.301958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733893-4813-4b7b-96ea-c646f766d6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:48.301958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17733893-4813-4b7b-96ea-c646f766d6f2 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:48.304516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 821/1644] 10.222.0.25 () {54 vars in 960 bytes} [Tue May 17 18:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:12:48.321318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3c9c2-72c0-4890-827d-d26ea76b3d4f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:48.321846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3c9c2-72c0-4890-827d-d26ea76b3d4f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:48.326150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa3c9c2-72c0-4890-827d-d26ea76b3d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:48.405063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cfa3c9c2-72c0-4890-827d-d26ea76b3d4f None None] MFA Rules not processed for user `b07f105e72884b37a1e9a9bed0415466`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:48.407907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cfa3c9c2-72c0-4890-827d-d26ea76b3d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:48.591199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 824/1645] 10.222.0.25 () {58 vars in 1057 bytes} [Tue May 17 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:48.600763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17733893-4813-4b7b-96ea-c646f766d6f2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:48.626951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17733893-4813-4b7b-96ea-c646f766d6f2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:48.647133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:48.648408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:48.648884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:48.649377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:48.657931 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:48.699411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:48.703621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:48.741006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:48.741482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:48.741761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:48.759094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 822/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:48.823691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] MFA Rules not processed for user `8ba97b67ecf64476a630fd3667d617fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:48.828879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:49.002769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 825/1647] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:49.018594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:49.038351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912c639-4789-4647-85c1-f58372bca8e3 service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:49.054966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:49.057265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:49.057679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:49.058063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:49.080535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:49.084811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd2a20f-b2a0-4827-b19c-e1d0b7867fb2 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:49.108607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 823/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:49.762076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:49.948901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f780c77-95ab-47ac-8191-35bfb678ae28 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:49.971120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:49.972681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:49.973103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:49.973748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] PATH_INFO: `/v3/users/a502437b0aa84ee0afc7a1d9a637e0c7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:49.978115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a502437b0aa84ee0afc7a1d9a637e0c7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:49.992499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:50.147544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a502437b0aa84ee0afc7a1d9a637e0c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:50.177864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a502437b0aa84ee0afc7a1d9a637e0c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:50.178882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a502437b0aa84ee0afc7a1d9a637e0c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:50.179836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a502437b0aa84ee0afc7a1d9a637e0c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:50.205526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a502437b0aa84ee0afc7a1d9a637e0c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:50.235516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 826/1649] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:12:49 2022] DELETE /identity/v3/users/a502437b0aa84ee0afc7a1d9a637e0c7 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:50.241388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:50.242238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:50.242688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:50.296350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:50.297626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:50.534143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 824/1650] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:50.555053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:50.557159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:50.732280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:50.735218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:50.757405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1184d81-2bcd-4d82-8f49-0b2c7c55eebf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:50.762325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:50.763059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:50.763314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:50.763752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:50.788478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:50.789362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa6309-a155-4549-97f6-ae320e3765fc None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:50.793600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee18fe2-5ccb-436f-8307-10d4aa1e2f72 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:50.822337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:50.823666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:50.825493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:50.825944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 827/1651] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:50.826299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] PATH_INFO: `/v3/users/63dd586a18634b64ab482b6b33c374e4` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:50.830195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=63dd586a18634b64ab482b6b33c374e4)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:50.835766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: WARNING py.warnings [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:50.835766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: warnings.warn(msg) May 17 18:12:50.835766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: May 17 18:12:50.837934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:51.021767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63dd586a18634b64ab482b6b33c374e4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:51.070403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63dd586a18634b64ab482b6b33c374e4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:51.072954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63dd586a18634b64ab482b6b33c374e4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:51.104233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63dd586a18634b64ab482b6b33c374e4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:51.123700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-62b711d1-de74-45fa-b1e2-627548bd3cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63dd586a18634b64ab482b6b33c374e4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:51.132189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 825/1652] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:12:50 2022] DELETE /identity/v3/users/63dd586a18634b64ab482b6b33c374e4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:51.137493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:51.138021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:51.138297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:51.191208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:51.198874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:51.378188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15142-2fd2-4e6d-80fd-e7e4e4f191bf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:51.379039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15142-2fd2-4e6d-80fd-e7e4e4f191bf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:51.379461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b15142-2fd2-4e6d-80fd-e7e4e4f191bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:51.382051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 828/1653] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:51.404609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:51.406514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:51.474984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a9b15142-2fd2-4e6d-80fd-e7e4e4f191bf None None] MFA Rules not processed for user `c7b641ce301a4b7685f0f70d7ac4a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:51.478219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a9b15142-2fd2-4e6d-80fd-e7e4e4f191bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:51.497395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6706bc73-616b-465a-ba1e-539c36457a60 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:51.502456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:51.503282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:51.503807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:51.504153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:51.517975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:51.521515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:51.544744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 829/1654] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:51.708972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 826/1655] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:51.724980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:51.726461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:51.834397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f1277b-1b11-4e76-a349-4af6d0fe737c service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:51.845242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:51.846235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:51.847444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:51.847921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:51.859161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:51.861333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:51.890094 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 830/1656] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:52.299897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:52.300447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:52.300869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:52.342020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:52.344489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:52.472976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 827/1657] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:12:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:52.755068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:52.756830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:52.795117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:52.796875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:52.801152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec61af4-762a-45a2-865c-067be1342c8c service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:52.816666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:52.817910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:52.818298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:52.818595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] PATH_INFO: `/v3/users/c2b0f1d86c5a4cdeb5b0f9da35dcae8f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:52.821098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b0f1d86c5a4cdeb5b0f9da35dcae8f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:52.828437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:52.949285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b0f1d86c5a4cdeb5b0f9da35dcae8f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:52.976333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379940-971e-4bcd-9454-990d72458cf5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:52.989477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b0f1d86c5a4cdeb5b0f9da35dcae8f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:52.990384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:52.991548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b0f1d86c5a4cdeb5b0f9da35dcae8f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:52.992338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:52.992677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b0f1d86c5a4cdeb5b0f9da35dcae8f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:52.993280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:52.993781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.010429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d99291dd-d60b-4483-bb50-270dafedc0e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b0f1d86c5a4cdeb5b0f9da35dcae8f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.011411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.029184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:53.033393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:53.052282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 831/1658] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:12:52 2022] DELETE /identity/v3/users/c2b0f1d86c5a4cdeb5b0f9da35dcae8f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:53.059397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.060092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.062099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.064580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 828/1659] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:12:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:12:53.099101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:53.102106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.155441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:53.156906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.188066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c263c8e-4096-4161-8a15-f75a2c05f778 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:53.260845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 832/1660] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:53.310468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:53.312436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.410609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:53.412090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.412579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.413012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] PATH_INFO: `/v3/projects/69fb47a4ee9d4f03b6d1bd55075af2fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.418890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=69fb47a4ee9d4f03b6d1bd55075af2fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:53.424231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:53.491865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b6955-c6da-4080-a2b5-2fea4cd97173 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:53.502990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:53.503745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.504132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.504508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.535821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:53.537814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:53.545577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69fb47a4ee9d4f03b6d1bd55075af2fd', 'request_id': 'req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.563251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69fb47a4ee9d4f03b6d1bd55075af2fd', 'request_id': 'req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.567980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 833/1661] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:12:53.585778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69fb47a4ee9d4f03b6d1bd55075af2fd', 'request_id': 'req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.606599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:53.608248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.620335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] The token cache is being invalidate because project 69fb47a4ee9d4f03b6d1bd55075af2fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:12:53.622443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.625325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-99a9281c-0d21-4ca6-aa4f-b1d932759eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:53.633603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02456f-7411-4a7b-9d3e-0f4fa8e0f8c3 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:53.634055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 829/1662] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:12:53 2022] DELETE /identity/v3/projects/69fb47a4ee9d4f03b6d1bd55075af2fd => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:12:53.641471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f66d3-1200-47b9-82eb-16a9209aaeb2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.642304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f66d3-1200-47b9-82eb-16a9209aaeb2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.643307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25f66d3-1200-47b9-82eb-16a9209aaeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.698192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b25f66d3-1200-47b9-82eb-16a9209aaeb2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:53.700170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b25f66d3-1200-47b9-82eb-16a9209aaeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.788939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:53.790231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.793738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.794226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] PATH_INFO: `/v3/projects/6bd19a1a4e6e40629d90609e92b37e66` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.795769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd19a1a4e6e40629d90609e92b37e66)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:53.807609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: WARNING py.warnings [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 17 18:12:53.807609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: warnings.warn(msg) May 17 18:12:53.807609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: May 17 18:12:53.809270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:53.860003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 830/1663] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:53.869077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:53.870218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:53.870885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:53.940468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:53.948184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:53.999286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd19a1a4e6e40629d90609e92b37e66', 'request_id': 'req-6e942586-17cc-440f-982f-e5cc005949c2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.017720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd19a1a4e6e40629d90609e92b37e66', 'request_id': 'req-6e942586-17cc-440f-982f-e5cc005949c2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.049149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd19a1a4e6e40629d90609e92b37e66', 'request_id': 'req-6e942586-17cc-440f-982f-e5cc005949c2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.093625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] The token cache is being invalidate because project 6bd19a1a4e6e40629d90609e92b37e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:12:54.095411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.097319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.101704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 834/1664] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:12:53 2022] DELETE /identity/v3/projects/6bd19a1a4e6e40629d90609e92b37e66 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:54.106713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.110208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:54.140968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 831/1665] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:54.144920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.160358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e942586-17cc-440f-982f-e5cc005949c2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.179411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.181182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6337e6-1bc5-45b2-b3aa-9be377d934e4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.183651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.185565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.185995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] PATH_INFO: `/v3/users/7f652af4c53c4af48c07ee9451595d1c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.189946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.190337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f652af4c53c4af48c07ee9451595d1c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.190944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.191069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.191355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.192186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:54.192994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.196179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.197915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.227501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:54.229238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.277937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bf76b2-261c-4bbe-be3c-e9958fe3116c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.297172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.298109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.298757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.299412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.300313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.304036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.332655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f652af4c53c4af48c07ee9451595d1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.373991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 833/1667] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:54 2022] POST /identity/v3/projects => generated 403 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:54.379176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.382663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f652af4c53c4af48c07ee9451595d1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.384763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f652af4c53c4af48c07ee9451595d1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.387762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f652af4c53c4af48c07ee9451595d1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.407737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f652af4c53c4af48c07ee9451595d1c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:54.445646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 835/1668] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:12:54 2022] DELETE /identity/v3/users/7f652af4c53c4af48c07ee9451595d1c => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:54.557917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50398c-9f3c-4348-9dc8-e3cbe81d270c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.722780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.723490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.723777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.724057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.724768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.738246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.792809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 834/1669] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:54 2022] POST /identity/v3/users => generated 302 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:54.797283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.799378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:54.835278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446ac37-8271-4587-815b-ad057d40f979 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.848429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.850417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.851404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.853325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.854552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.861213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.913642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 836/1670] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:54.916298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.926669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29a39a-b14c-46b2-b748-bae7fe057d61 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:54.939231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:54.939740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:54.940025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:54.940301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:54.941228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:54.943203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8788e5e-fdbd-4099-b3a6-1c5caf8d6ee4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:54.970638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 835/1671] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:54.974944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:54.985876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe986ef-2769-4574-95fa-35bacd5912b8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:55.003001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:55.003941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:55.004213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:55.004491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] PATH_INFO: `/v3/projects/82173c681b3446d7850afe57393f78a7/users/76850a8d5470485c8f4d79a74c812d2e/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:55.040680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82173c681b3446d7850afe57393f78a7, user_id=76850a8d5470485c8f4d79a74c812d2e, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:55.049590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:55.069945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 837/1672] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:54 2022] PUT /identity/v3/projects/82173c681b3446d7850afe57393f78a7/users/76850a8d5470485c8f4d79a74c812d2e/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:55.084080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:55.084080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:55.084080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:55.140925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] MFA Rules not processed for user `76850a8d5470485c8f4d79a74c812d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:55.142187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:55.288225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 836/1673] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:55.292710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:55.465295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9173ed-fc12-412d-ba78-be22dcdcaf62 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:55.473622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:55.475672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:55.476394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:55.476931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:55.480045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:55.484699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:55.554487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 838/1674] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:55 2022] POST /identity/v3/projects => generated 405 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:55.556467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:55.574070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e465f-77e7-4caf-b430-c3434b776de9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:55.724210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:55.725174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:55.725614 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:55.744703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:55.748885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:55.751253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:55.831103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 837/1675] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:55 2022] POST /identity/v3/users => generated 309 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:55.835955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:55.873524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7408b9d-457d-4a90-8f4a-4151077fe43f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:55.904464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:55.905287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:55.905639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:55.905975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:55.907028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:55.910378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:55.957745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:55.957921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 839/1676] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:55.982185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3951e5d-97ae-4dca-8e7a-7ab6dde5df2c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:56.013397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:56.014527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:56.014937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:56.015324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] PATH_INFO: `/v3/projects/81009f0805c249879b7a0568be8142b6/users/8d94d85f30dd448ab04f892dcb433d1b/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:56.065954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81009f0805c249879b7a0568be8142b6, user_id=8d94d85f30dd448ab04f892dcb433d1b, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:56.070397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:56.110754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 838/1677] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:55 2022] PUT /identity/v3/projects/81009f0805c249879b7a0568be8142b6/users/8d94d85f30dd448ab04f892dcb433d1b/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:56.111519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:56.129351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e8f38-5667-4e6d-8afb-7ed0d78f1a8a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:56.283229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:56.284143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:56.285911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:56.286331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:56.288328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:56.293261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b01e66-f49d-4f1e-b90c-55f5ab55e1f0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:56.320894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:56.321093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 840/1678] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:56 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:12:56.357459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff65f51-2073-40f4-be54-bf56c48ecd27 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:56.394170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:56.395079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:56.397754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:56.398046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] PATH_INFO: `/v3/projects/81009f0805c249879b7a0568be8142b6/users/8d94d85f30dd448ab04f892dcb433d1b/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:56.402380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81009f0805c249879b7a0568be8142b6, user_id=8d94d85f30dd448ab04f892dcb433d1b, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:56.413068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734ad35a-ad7c-4a4a-8f2b-931e7c2c0a17 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:56.479177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 839/1679] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:56 2022] PUT /identity/v3/projects/81009f0805c249879b7a0568be8142b6/users/8d94d85f30dd448ab04f892dcb433d1b/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:56.481558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:56.481914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:56.482257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:56.528360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] MFA Rules not processed for user `8d94d85f30dd448ab04f892dcb433d1b`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:56.529875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:56.627248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:56.628159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:56.628159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:56.684926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:56.685960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:56.783241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 841/1680] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:56 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:56.803161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:56.805874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:56.976238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 840/1681] 10.222.0.64 () {58 vars in 1015 bytes} [Tue May 17 18:12:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:57.052816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85135aa2-8a77-4012-b188-4ec28a680ebc None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:57.069689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:57.070877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:57.071421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:57.072007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:57.097565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:57.099493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:57.104226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:57.106547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:57.123129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a133daf-19ba-401f-9e0c-71d4fa2615ab None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:57.143086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 842/1682] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:56 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:57.144515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:57.155494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:57.156340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:57.156839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:57.181273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:57.184245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:57.247097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 841/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:12:57.512482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:57.551604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:57.553688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:57.737941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68535ca8-fdd7-4ef1-b1c1-7b1a6ae878fe service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:57.749979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:57.751261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:57.751552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:57.751832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] PATH_INFO: `/v3/users/76850a8d5470485c8f4d79a74c812d2e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:57.758133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76850a8d5470485c8f4d79a74c812d2e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:57.765933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:57.811080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c8a56-d2f7-4bd6-b9d5-12005e95b812 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:57.835473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:57.841587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:57.842429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:57.842999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] PATH_INFO: `/v3/projects/788a21ae115d46e08969bbfc883ea659` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:57.847419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=788a21ae115d46e08969bbfc883ea659)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:57.856132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:57.879492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76850a8d5470485c8f4d79a74c812d2e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:57.913851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76850a8d5470485c8f4d79a74c812d2e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:57.922012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76850a8d5470485c8f4d79a74c812d2e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:57.923165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76850a8d5470485c8f4d79a74c812d2e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:57.935218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76850a8d5470485c8f4d79a74c812d2e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:57.979058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 843/1684] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:12:57 2022] DELETE /identity/v3/users/76850a8d5470485c8f4d79a74c812d2e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:57.983123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:57.987431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:58.034634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '788a21ae115d46e08969bbfc883ea659', 'request_id': 'req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:58.057051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '788a21ae115d46e08969bbfc883ea659', 'request_id': 'req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:58.074854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '788a21ae115d46e08969bbfc883ea659', 'request_id': 'req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:58.108472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] The token cache is being invalidate because project 788a21ae115d46e08969bbfc883ea659 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:12:58.109751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:58.111540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c3ce27ad-7e4d-4adb-aee9-eedd51c549b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:58.114297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 842/1685] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:12:57 2022] DELETE /identity/v3/projects/788a21ae115d46e08969bbfc883ea659 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:58.117086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5f4d-6b2f-4d67-a471-43eaad848466 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.117779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5f4d-6b2f-4d67-a471-43eaad848466 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.119021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e5f4d-6b2f-4d67-a471-43eaad848466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.173595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-325e5f4d-6b2f-4d67-a471-43eaad848466 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:58.175197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-325e5f4d-6b2f-4d67-a471-43eaad848466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:58.208423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70742e7-89de-4af7-b455-cbc2dbf15045 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:58.433510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 843/1686] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:58.436682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae14-3e9a-4638-a6db-ce4209091ce7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.437479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae14-3e9a-4638-a6db-ce4209091ce7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.437871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be1ae14-3e9a-4638-a6db-ce4209091ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.496096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9be1ae14-3e9a-4638-a6db-ce4209091ce7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:58.498449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9be1ae14-3e9a-4638-a6db-ce4209091ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:58.521503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 844/1687] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:58.533164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.534728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.535205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.593092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:58.595916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:58.628607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 845/1688] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:58.628607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:58.633337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:58.800029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e5831-9eab-4e85-aa18-83c3f5f162a6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:58.817814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:58.818690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.819084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.819468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.848300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:58.849978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:58.879397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:58.880560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.880999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.881415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] PATH_INFO: `/v3/projects/4c4fcce854e14091939e4f379f438762` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.883878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c4fcce854e14091939e4f379f438762)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:58.886627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:58.888419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 846/1689] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:12:58.890173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:58.926282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f4e9cd-dfdc-4611-ab92-2bae82e7d9b0 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:58.942840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:58.944858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:58.948027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:58.948638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:58.953220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:58.955101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:58.963752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.024813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 847/1690] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:59.027310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.051823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c4fcce854e14091939e4f379f438762', 'request_id': 'req-31a39c2f-1999-4850-aeb5-dba352f6bbf1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:59.067279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c4fcce854e14091939e4f379f438762', 'request_id': 'req-31a39c2f-1999-4850-aeb5-dba352f6bbf1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:59.080014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c4fcce854e14091939e4f379f438762', 'request_id': 'req-31a39c2f-1999-4850-aeb5-dba352f6bbf1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:59.099683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] The token cache is being invalidate because project 4c4fcce854e14091939e4f379f438762 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:12:59.099984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:59.101262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31a39c2f-1999-4850-aeb5-dba352f6bbf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:12:59.104861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 844/1691] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:12:57 2022] DELETE /identity/v3/projects/4c4fcce854e14091939e4f379f438762 => generated 0 bytes in 1125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:12:59.106949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b3fcc-33c2-4484-b889-240690c539b7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.109879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b25-df7b-46b3-a71e-21abb8a00757 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.110349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b25-df7b-46b3-a71e-21abb8a00757 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.110806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8095b25-df7b-46b3-a71e-21abb8a00757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.149145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a8095b25-df7b-46b3-a71e-21abb8a00757 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:59.151280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a8095b25-df7b-46b3-a71e-21abb8a00757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:59.268659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.269561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.269958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.270346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.271195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.273249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.299925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 845/1692] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:12:59.301921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.302385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.302838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.335465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 848/1693] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/projects => generated 377 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:59.336954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.346078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:59.351946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:12:59.353247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:12:59.488716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03badc7e-4406-4ce4-b61e-03b957205e17 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.505202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.506167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.506596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.507035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.507849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.513842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.535210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 846/1694] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:12:59.536424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.562387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64324f-d5ba-4356-aa24-d5495a82473c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.574998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 849/1695] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/users => generated 289 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:59.578513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.578713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.579381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.579665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.579946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.580687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:12:59.580993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.591913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.599682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29b8ff0-2052-4065-9720-8ae73e045ab1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.618478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.619357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.619749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.620133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.621043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.622858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.626295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 847/1696] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:12:59.627272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.641918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 850/1697] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:59.651527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.657127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe191f32-75a8-4a65-a6f2-65f3d5a071b9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.676328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.677023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.677310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.677593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.689073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a1ceb-bdd8-40c6-9d37-6ed5073bdb27 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.689287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.689287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.695509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.696361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.696759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.697195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.698333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.712013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.739381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 851/1698] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:12:59.740576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.763448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 848/1699] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:12:59.764573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:12:59.766513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480f214-4912-45a3-a60e-ab21bc345eee admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.932509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.934127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.934600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.935047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] PATH_INFO: `/v3/projects/652adfad3b614fcb9114145d4c26c7f4/users/e32208965b5f4a67b80cb4aba0b1e787/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:12:59.951881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c848b-84d7-4bd0-ab07-d55035234b47 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:12:59.976045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652adfad3b614fcb9114145d4c26c7f4, user_id=e32208965b5f4a67b80cb4aba0b1e787, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:12:59.982376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96dc55c-6f45-4afc-9e00-50d81c58b4b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:12:59.995706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:12:59.996595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:12:59.996890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:12:59.997169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.006698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.014716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 852/1700] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:12:59 2022] PUT /identity/v3/projects/652adfad3b614fcb9114145d4c26c7f4/users/e32208965b5f4a67b80cb4aba0b1e787/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:00.016438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.025124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.025368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.025640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.087011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 849/1701] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:12:59 2022] POST /identity/v3/users => generated 282 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:00.088790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:00.135665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] MFA Rules not processed for user `e32208965b5f4a67b80cb4aba0b1e787`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:00.135665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:00.145804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb884c-3b0a-45b1-8eff-41e10ba8f1ee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:00.267217 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:00.268001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.268368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.268712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.269688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.276644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.308427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 850/1702] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:00.311868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:00.337204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021cd07-6e41-4ac1-a918-19987e2df79c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:00.354377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:00.355176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.355459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.355732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.356464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.358082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.377826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 853/1703] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:00.385030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:00.390800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 851/1704] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:00.392593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:00.417939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b774b2-6ed2-4389-99ca-1fade392ec3e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:00.420656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf43a5-1463-40e3-9860-d30aeae9f11d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:00.434033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:00.434792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.435273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.437536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.439393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.439591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:00.440682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.442953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.444266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.448122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] PATH_INFO: `/v3/projects/6be48105c9e344d4bd9ee8e2506c0408/users/7989eff21e73436e938aeaf100c602f5/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.499407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6be48105c9e344d4bd9ee8e2506c0408, user_id=7989eff21e73436e938aeaf100c602f5, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.505108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47f0f40-ac14-40fa-9877-80d0d2f428af admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.556837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 854/1705] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:00 2022] POST /identity/v3/projects => generated 377 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:00.565179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:00.581647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 852/1706] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:00 2022] PUT /identity/v3/projects/6be48105c9e344d4bd9ee8e2506c0408/users/7989eff21e73436e938aeaf100c602f5/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:00.597937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.597937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.597937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.748816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] MFA Rules not processed for user `7989eff21e73436e938aeaf100c602f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:00.750050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:00.866235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8fb9b-9e4f-472d-87ed-52162c07fb04 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:00.889978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:00.891597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:00.893111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:00.895057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:00.898604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:00.905925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:00.991370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 855/1707] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:00 2022] POST /identity/v3/users => generated 289 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:00.995525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.033487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5024-6fb5-4d25-92e8-371e3fd175ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.059008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.059716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.060002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.060278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.061051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.067650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.071907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 853/1708] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 480 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:01.077781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.099399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 856/1709] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:01.100395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.101634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0bcc5a-f976-40b4-a193-494521bada2d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.113466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.115591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.119161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.120841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.123528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.129802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.139325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edbcfe-4ebe-4001-8ca1-e0ef8b648022 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.172839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.174059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.174655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.175150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.176213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.178227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.219210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 854/1710] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:01 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:01.221334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.258743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 857/1711] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:01.260172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.332947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b36468e-ee80-44dd-8414-1314b362e116 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.378189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda59a07-5110-4b7b-a3f4-1bcc6b61901f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.388642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.389545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.389982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.391233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.392133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.394523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.436296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 855/1712] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:01 2022] POST /identity/v3/users => generated 289 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:01.438671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.472335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5743626-71f2-4329-9b07-2a9bcb5f8aba admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.479569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.480107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.480398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.480870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.481625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.487148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.511640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 856/1713] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:01.515165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.547417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5f0c6-695d-4c1a-ad80-29fa225c0095 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.564506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.564736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.565604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.565889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.566203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] PATH_INFO: `/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4/users/27449989259743d6a6b1d0fce9f22b27/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.566635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.567218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.568269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] PATH_INFO: `/v3/projects/f67fc05609e34043b73b0b86ecf9858a/users/a396e42653bc4089b14781498f930d89/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.588662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67fc05609e34043b73b0b86ecf9858a, user_id=a396e42653bc4089b14781498f930d89, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.614839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdc2faf8bc845e88e85ebf21178a3c4, user_id=27449989259743d6a6b1d0fce9f22b27, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:01.617568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.634038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c414b611-4d81-4639-87ac-b5762a0077b3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:01.651361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 857/1714] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:01 2022] PUT /identity/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4/users/27449989259743d6a6b1d0fce9f22b27/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:01.653068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.682063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 858/1715] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:01 2022] PUT /identity/v3/projects/f67fc05609e34043b73b0b86ecf9858a/users/a396e42653bc4089b14781498f930d89/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:01.706766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:01.707051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:01.707331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:01.778108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] MFA Rules not processed for user `a396e42653bc4089b14781498f930d89`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:01.780271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:01.849787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe6e01-2ef1-48ed-bca2-2e9fdbb5225f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:01.919443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 859/1716] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:01.955595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:01.998903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:01.999829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.000260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.000679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.001568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.004368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:02.032596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 858/1717] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:02.035898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:02.053082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d922281-b6ac-4df1-b42f-7f51a4b1ccac admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:02.078052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:02.079017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.079300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.079606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] PATH_INFO: `/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4/users/27449989259743d6a6b1d0fce9f22b27/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.084071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdc2faf8bc845e88e85ebf21178a3c4, user_id=27449989259743d6a6b1d0fce9f22b27, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.086807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b18d92-e9c5-4d2a-ace7-1fac111f8a69 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:02.114922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 859/1718] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:02 2022] PUT /identity/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4/users/27449989259743d6a6b1d0fce9f22b27/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:02.114922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ff80-5f1c-42ec-87f4-490bac3bf641 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.114922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ff80-5f1c-42ec-87f4-490bac3bf641 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.114922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88ff80-5f1c-42ec-87f4-490bac3bf641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.160042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ed88ff80-5f1c-42ec-87f4-490bac3bf641 None None] MFA Rules not processed for user `8ba97b67ecf64476a630fd3667d617fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:02.161422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ed88ff80-5f1c-42ec-87f4-490bac3bf641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:02.175353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c05d96-a254-441e-83f6-2278182f7a24 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:02.340407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:02.341371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.341806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.342221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.343131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.346656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:02.348510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 860/1719] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:02.363519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.369406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.372377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.407046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 860/1720] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:01 2022] POST /identity/v3/projects => generated 379 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:02.411012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:02.485219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] MFA Rules not processed for user `27449989259743d6a6b1d0fce9f22b27`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:02.485219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:02.645230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad3f3d-7812-41df-b68c-fa30bb820525 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:02.659543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:02.662232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.662765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.663263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.664248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.672690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79916df6-afa7-4bb9-a88e-a63a1aca54c1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:02.759107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 861/1721] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:02 2022] POST /identity/v3/users => generated 296 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:02.773591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 861/1722] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:02 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:02.774472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:02.778564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.780793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.781151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.784798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 862/1723] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:13:02 2022] GET /identity => generated 270 bytes in 28 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:02.785800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:02.790180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:02.798674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6813d3-f8a3-4c83-b4a0-4fe6fbae8a1a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:02.818757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:02.819583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.819868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.820141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.820875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.823490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:02.877084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 862/1724] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:02.881320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:02.905417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7966b-5e91-4335-b6e4-36bd8155e474 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:02.933119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:02.934263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:02.934546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:02.934961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] PATH_INFO: `/v3/projects/f4fc468128a84688999ee9a764b112ab/users/b3b0bcea8dbb4988a31f4554717e7fe9/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:02.971099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fc468128a84688999ee9a764b112ab, user_id=b3b0bcea8dbb4988a31f4554717e7fe9, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:02.973842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9939-2686-43f8-810c-19719026d95a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:03.007270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 863/1725] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:02 2022] PUT /identity/v3/projects/f4fc468128a84688999ee9a764b112ab/users/b3b0bcea8dbb4988a31f4554717e7fe9/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:03.008797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.009088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.009470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.034736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:03.035988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:03.040058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81304c-916e-4023-8703-65b11128ef43 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:03.242179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:03.243400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.244037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.244465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.270250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 864/1726] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:03.271568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:03.470518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2324be1-42e0-44ad-8327-595f16180219 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:03.496387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:03.497361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.497633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.498065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.504637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:03.506455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:03.534451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 865/1727] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:03.539953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:03.547715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:03.550507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:03.559872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:03.590405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf45dd-a048-453d-ba02-43d093c2c613 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:03.596166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 863/1728] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:02 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 811 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:03.600098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:03.606811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:03.607495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.607774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.608068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.633706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097143b1-311a-49b7-9e17-d7e7d79ea35c service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:03.637049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:03.642282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab16b45-2c5e-4524-b05e-5ad6ee6ad8d3 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:03.650895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:03.653566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.655757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.656906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] PATH_INFO: `/v3/projects/f4fc468128a84688999ee9a764b112ab/users/b3b0bcea8dbb4988a31f4554717e7fe9/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.664419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4fc468128a84688999ee9a764b112ab, user_id=b3b0bcea8dbb4988a31f4554717e7fe9, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:03.673916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fed235-1707-4c23-96e8-d1ad54270041 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:03.708024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 864/1729] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:03 2022] PUT /identity/v3/projects/f4fc468128a84688999ee9a764b112ab/users/b3b0bcea8dbb4988a31f4554717e7fe9/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:03.720790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.721506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.724739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.735009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 866/1730] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:03.771764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:03.772316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:03.774124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:03.818979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] MFA Rules not processed for user `b3b0bcea8dbb4988a31f4554717e7fe9`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:03.821698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:03.847685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] MFA Rules not processed for user `c7b641ce301a4b7685f0f70d7ac4a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:03.849013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:03.948170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 867/1731] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:03.949654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:03.999464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 865/1732] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:04.018673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:04.020908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:04.130966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809171ec-e388-433a-a202-d66c1d5e4145 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:04.147262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:04.147948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:04.148228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:04.148501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:04.190188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62226183-bde8-4f88-9c75-2737a9925fc0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:04.204131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:04.205214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:04.205352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:04.205512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:04.244615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:04.251286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:04.283203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 866/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:04.284666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:04.289678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:04.307678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:04.309598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:04.341337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 868/1734] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:03 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:04.395800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:04.407303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97415199-3b2d-4dc6-abed-ca1b2a1c56e6 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:04.415239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:04.418207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:04.418487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:04.419419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:04.423223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c67b30-e710-4b2f-bf56-071437b396c1 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:04.435709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:04.438779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:04.439066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:04.439345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] PATH_INFO: `/v3/projects/82173c681b3446d7850afe57393f78a7` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:04.441757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82173c681b3446d7850afe57393f78a7)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:04.444006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:04.584537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:04.585977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da121-df56-4bcd-a4db-62b2eb09175a service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:04.611201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82173c681b3446d7850afe57393f78a7', 'request_id': 'req-a7777651-9713-4a87-88c3-c5dca1ffa702'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:04.635557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82173c681b3446d7850afe57393f78a7', 'request_id': 'req-a7777651-9713-4a87-88c3-c5dca1ffa702'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:04.636208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 869/1735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:04.639131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51505-e3b3-4c03-9dd2-7b997d96f41c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:04.640726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51505-e3b3-4c03-9dd2-7b997d96f41c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:04.641275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca51505-e3b3-4c03-9dd2-7b997d96f41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:04.669461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82173c681b3446d7850afe57393f78a7', 'request_id': 'req-a7777651-9713-4a87-88c3-c5dca1ffa702'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:04.705911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] The token cache is being invalidate because project 82173c681b3446d7850afe57393f78a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:04.706254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:04.710460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:04.721042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 867/1736] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:04 2022] DELETE /identity/v3/projects/82173c681b3446d7850afe57393f78a7 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:04.725296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:04.731167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:04.754285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aca51505-e3b3-4c03-9dd2-7b997d96f41c None None] MFA Rules not processed for user `17c2097983df461eb7c23bc0ed7b7520`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:04.756237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aca51505-e3b3-4c03-9dd2-7b997d96f41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:04.955562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 870/1737] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:05.063421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7777651-9713-4a87-88c3-c5dca1ffa702 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:05.081322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:05.082479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:05.082650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:05.082903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] PATH_INFO: `/v3/users/8d94d85f30dd448ab04f892dcb433d1b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:05.094132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d94d85f30dd448ab04f892dcb433d1b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:05.104794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:05.231722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d94d85f30dd448ab04f892dcb433d1b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:05.258560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d94d85f30dd448ab04f892dcb433d1b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:05.260174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d94d85f30dd448ab04f892dcb433d1b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:05.278128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d94d85f30dd448ab04f892dcb433d1b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:05.296546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-0a724b54-35a7-4b6c-820a-e9893a93e4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d94d85f30dd448ab04f892dcb433d1b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:05.303930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 868/1738] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:04 2022] DELETE /identity/v3/users/8d94d85f30dd448ab04f892dcb433d1b => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:06.460059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:06.461765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:06.462913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:06.466744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 871/1739] 10.222.0.25 () {54 vars in 912 bytes} [Tue May 17 18:13:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:06.477647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:06.479400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:06.479953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:06.532108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:06.533705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:06.583428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:06.588400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:06.748784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 869/1740] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:06.790134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:06.793134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:06.821927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363293a-43fd-4d67-a94a-b0beff698ce5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:06.839075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:06.839870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:06.842470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:06.842935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:06.866520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:06.868132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4b936-ac8f-43a9-a447-9115e1584a87 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:06.916488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 870/1741] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:06.926284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bae8-53e1-4b65-b82c-26ed558841ca None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:06.927294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bae8-53e1-4b65-b82c-26ed558841ca None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:06.929277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b3bae8-53e1-4b65-b82c-26ed558841ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:06.941224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2d18f-806c-46ae-ba0a-502e741aaa0a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:06.967551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:06.968000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:06.968279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:06.972678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:06.981109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:07.049357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-70b3bae8-53e1-4b65-b82c-26ed558841ca None None] MFA Rules not processed for user `62a9f27a865b468989f672a05dbab350`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:07.053417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70b3bae8-53e1-4b65-b82c-26ed558841ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:07.295286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 871/1742] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:07.318306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:07.319549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:07.319867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:07.320249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:07.328925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:07.354257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 872/1743] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:07.381432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] MFA Rules not processed for user `62a9f27a865b468989f672a05dbab350`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:07.392328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:07.399389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:07.401962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:07.413910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 872/1744] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:07.592250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bc17d-3309-4c8e-8659-8b3cbfd19d3b service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:07.600738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:07.601922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:07.604824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:07.605528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] PATH_INFO: `/v3/projects/81009f0805c249879b7a0568be8142b6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:07.607311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81009f0805c249879b7a0568be8142b6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:07.609718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:07.635907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:07.661799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ddd4c-6c24-4a16-8f28-10261f298a2e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:07.698953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:07.699771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:07.700153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:07.701503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:07.731770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:07.744228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aad27-1d76-4b2d-bdf3-30d67f6f92c0 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:07.778271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 873/1745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:07.785905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81009f0805c249879b7a0568be8142b6', 'request_id': 'req-d97f45ed-e2d8-48ea-aa31-4a6957dce882'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:07.804755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81009f0805c249879b7a0568be8142b6', 'request_id': 'req-d97f45ed-e2d8-48ea-aa31-4a6957dce882'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:07.827392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81009f0805c249879b7a0568be8142b6', 'request_id': 'req-d97f45ed-e2d8-48ea-aa31-4a6957dce882'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:07.856150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] The token cache is being invalidate because project 81009f0805c249879b7a0568be8142b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:07.860532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:07.872727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d97f45ed-e2d8-48ea-aa31-4a6957dce882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:07.881753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 873/1746] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:07 2022] DELETE /identity/v3/projects/81009f0805c249879b7a0568be8142b6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:07.883301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:07.883708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:07.884203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:07.956550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:07.979253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:08.141355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 874/1747] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:08.151249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.151700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.152075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.188174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:08.191843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:08.211504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 874/1748] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:08.215868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.230887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b736c-ca9d-4354-9442-89c1e767cbf8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.244087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.245164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.245659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.246103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.246888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:08.247258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.248803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:08.284633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 875/1749] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:08.285735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.305379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940ddf2-310c-41f7-8c5c-7515cf531317 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.316357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.317091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.317634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.317921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.318657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.320591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:08.378661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 875/1750] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:08 2022] POST /identity/v3/projects => generated 363 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:08.382908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.397231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9e6bcd-74b4-4edb-85e3-812fc9e5401b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.582597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.583294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.583581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.583867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.584567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.586724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:08.636092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.643286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 876/1751] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:08 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:08.651861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5cb864-cc45-49af-be71-74d361253fb6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.660827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.661928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.662498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.663254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.664228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.668178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:08.735070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.754273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 876/1752] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:08.763873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcee85-75ee-47fe-a073-3061d386781d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.791872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.793055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.794065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.794714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.795791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.799454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8a2a7e-4204-4f90-bf3c-bf84715ba1d5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:08.823705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 877/1753] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:08.829533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:08.844195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0712a87-e217-4ff1-a606-ecb3249db524 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:08.855424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:08.858287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:08.858669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:08.859018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] PATH_INFO: `/v3/projects/6afec9c44f8045c89e19ee70a2b9a0b5/users/41ba70bdeefd4412a819b99c10c9554c/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:08.956344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6afec9c44f8045c89e19ee70a2b9a0b5, user_id=41ba70bdeefd4412a819b99c10c9554c, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:08.965325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:09.018665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 877/1754] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:08 2022] PUT /identity/v3/projects/6afec9c44f8045c89e19ee70a2b9a0b5/users/41ba70bdeefd4412a819b99c10c9554c/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:09.020635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37177-4405-4148-ba82-7493c4416787 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:09.021173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37177-4405-4148-ba82-7493c4416787 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:09.021700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37177-4405-4148-ba82-7493c4416787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:09.146615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-35a37177-4405-4148-ba82-7493c4416787 None None] MFA Rules not processed for user `41ba70bdeefd4412a819b99c10c9554c`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:09.149605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-35a37177-4405-4148-ba82-7493c4416787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:09.244320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:09.248831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:09.367839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 878/1755] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:09 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:09.374358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a37177-4405-4148-ba82-7493c4416787 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:09.431687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a14156-3f03-408a-9748-f003b44633db admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:09.446773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:09.447905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:09.448289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:09.448666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] PATH_INFO: `/v3/users/e32208965b5f4a67b80cb4aba0b1e787` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:09.451105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32208965b5f4a67b80cb4aba0b1e787)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:09.464356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:09.562730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a37177-4405-4148-ba82-7493c4416787 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:09.604713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:09.605420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:09.605704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:09.605980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:09.612830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:09.622711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:09.628339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32208965b5f4a67b80cb4aba0b1e787'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:09.667902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32208965b5f4a67b80cb4aba0b1e787'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:09.670956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32208965b5f4a67b80cb4aba0b1e787'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:09.672834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32208965b5f4a67b80cb4aba0b1e787'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:09.688298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7e0bc352-abed-4ef9-9a0a-7c19c3b1c688 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32208965b5f4a67b80cb4aba0b1e787'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:09.710844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 879/1756] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:09 2022] POST /identity/v3/projects => generated 363 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:09.713229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:09.718238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:09.720155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 878/1757] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:09 2022] DELETE /identity/v3/users/e32208965b5f4a67b80cb4aba0b1e787 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:09.724804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:09.725318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:09.725746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:09.769952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:09.771186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:09.851547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2d80f-eeee-445d-af5c-8a7409617673 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:09.933821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:09.934820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:09.935784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:09.937047 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:09.938090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:09.940310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:09.949270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 879/1758] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:09.956059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:09.957717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:09.982620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 880/1759] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:09 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:09.986542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:09.998254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdac23c-4b2f-4ef8-b44a-d5e2316a162e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.013192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.013328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.013722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.014335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.015259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.016890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.066387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 881/1760] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:10.073886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:10.109111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f18e83-9f9c-4a2d-a26f-06ceb39dacab None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.111367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15b4f8-574c-4518-9715-38efa226d262 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.116090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.117047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.117600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.118086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.128251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.129159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.129437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.129711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] PATH_INFO: `/v3/projects/448e7483c4304fd4b51369bf7764e274/users/3cf3fb84d771475db4829cf927810f49/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.133362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.135470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ec461-e416-4e96-a273-2fe297b62ead service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.167090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e7483c4304fd4b51369bf7764e274, user_id=3cf3fb84d771475db4829cf927810f49, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.168959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 880/1761] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:10.169801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.184578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.184789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.185046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.203225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 882/1762] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:10 2022] PUT /identity/v3/projects/448e7483c4304fd4b51369bf7764e274/users/3cf3fb84d771475db4829cf927810f49/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:10.209602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:10.234242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] MFA Rules not processed for user `62a9f27a865b468989f672a05dbab350`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:10.241163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:10.347808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01d293-98f6-4925-b88e-42c0c7ef0966 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.364233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.366282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.367410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.367859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.369485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.372139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58829549-973b-4dde-9586-916e41223c50 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.381174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 881/1763] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:10.392519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 883/1764] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:10.396356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:10.414986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3046b-a0d0-4ac1-933d-b2c95f71b492 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.426856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.428050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.429660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.430061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] PATH_INFO: `/v3/projects/448e7483c4304fd4b51369bf7764e274/users/3cf3fb84d771475db4829cf927810f49/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.434223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448e7483c4304fd4b51369bf7764e274, user_id=3cf3fb84d771475db4829cf927810f49, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.437940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.456428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 882/1765] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:10 2022] PUT /identity/v3/projects/448e7483c4304fd4b51369bf7764e274/users/3cf3fb84d771475db4829cf927810f49/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:10.467465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.468958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.469388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.540170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] MFA Rules not processed for user `3cf3fb84d771475db4829cf927810f49`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:10.543031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:10.687575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 884/1766] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:10.696481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:10.699181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:10.827792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9486b1-c556-4f61-b077-b074f36db762 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:10.839495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:10.840897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:10.841273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:10.842919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:10.879852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:10.883206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:10.910458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 883/1767] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:10 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:11.042555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:11.063740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a00512c-6b66-4ed4-a452-4f7862391677 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:11.070881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:11.072141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:11.073380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:11.073874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:11.076927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:11.189214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:11.190869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab298af5-3afd-4639-8cd0-e0f09c8b6d7e service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:11.215258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 885/1768] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:11 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:11.363260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:11.365328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:11.446913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:11.448365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:11.448933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:11.469080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] MFA Rules not processed for user `17c2097983df461eb7c23bc0ed7b7520`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:11.470983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:11.504673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d3134-4e55-4c41-a658-419e2e1afd1a service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:11.510508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:11.511484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:11.511767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:11.512093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] PATH_INFO: `/v3/projects/652adfad3b614fcb9114145d4c26c7f4` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:11.513807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652adfad3b614fcb9114145d4c26c7f4)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:11.517256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:11.581086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 886/1769] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:11 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:11.599079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652adfad3b614fcb9114145d4c26c7f4', 'request_id': 'req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:11.606301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652adfad3b614fcb9114145d4c26c7f4', 'request_id': 'req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:11.642097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652adfad3b614fcb9114145d4c26c7f4', 'request_id': 'req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:11.674295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] The token cache is being invalidate because project 652adfad3b614fcb9114145d4c26c7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:11.674827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:11.675702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:11.686345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:11.687095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 884/1770] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:11 2022] DELETE /identity/v3/projects/652adfad3b614fcb9114145d4c26c7f4 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:11.714249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5ce8e-a58e-4a62-9cda-1a7218866edb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:11.813575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:11.815442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:11.815442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:11.815442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] PATH_INFO: `/v3/users/a396e42653bc4089b14781498f930d89` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:11.823115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a396e42653bc4089b14781498f930d89)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:11.825615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:11.994525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a396e42653bc4089b14781498f930d89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:12.024832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a396e42653bc4089b14781498f930d89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:12.028062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a396e42653bc4089b14781498f930d89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:12.047864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a396e42653bc4089b14781498f930d89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:12.078264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a396e42653bc4089b14781498f930d89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:12.092877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 887/1771] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:11 2022] DELETE /identity/v3/users/a396e42653bc4089b14781498f930d89 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:13.091637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:13.093655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:13.113334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b4c0a-e6c4-441d-bf7c-b20e279cb7e0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:13.223345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:13.224356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:13.225563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:13.226177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] PATH_INFO: `/v3/projects/f67fc05609e34043b73b0b86ecf9858a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:13.228922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67fc05609e34043b73b0b86ecf9858a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:13.247084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:13.464052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67fc05609e34043b73b0b86ecf9858a', 'request_id': 'req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:13.483218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67fc05609e34043b73b0b86ecf9858a', 'request_id': 'req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:13.523980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67fc05609e34043b73b0b86ecf9858a', 'request_id': 'req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:13.573861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] The token cache is being invalidate because project f67fc05609e34043b73b0b86ecf9858a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:13.577733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:13.579686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:13.588655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 885/1772] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:13 2022] DELETE /identity/v3/projects/f67fc05609e34043b73b0b86ecf9858a => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:13.592635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:13.594811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:13.628895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eadc4c-5af7-4441-9416-039c7b11c98c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:13.914647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:13.916891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:13.917406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:13.917890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] PATH_INFO: `/v3/users/b3b0bcea8dbb4988a31f4554717e7fe9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:13.924573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3b0bcea8dbb4988a31f4554717e7fe9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:13.932013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:14.049174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3b0bcea8dbb4988a31f4554717e7fe9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:14.126726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3b0bcea8dbb4988a31f4554717e7fe9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:14.127986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3b0bcea8dbb4988a31f4554717e7fe9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:14.146978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3b0bcea8dbb4988a31f4554717e7fe9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:14.162173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-88d8b742-c256-4859-84b6-9840957bf107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3b0bcea8dbb4988a31f4554717e7fe9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:14.180865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 888/1773] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:13 2022] DELETE /identity/v3/users/b3b0bcea8dbb4988a31f4554717e7fe9 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:15.080975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:15.091238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:15.110275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d53c0-71b4-468f-919e-2c8bb7a71fee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:15.243929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:15.246889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:15.247382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:15.247809 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] PATH_INFO: `/v3/users/41ba70bdeefd4412a819b99c10c9554c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:15.249408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ba70bdeefd4412a819b99c10c9554c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:15.252750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:15.345067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ba70bdeefd4412a819b99c10c9554c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:15.361072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ba70bdeefd4412a819b99c10c9554c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:15.362121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ba70bdeefd4412a819b99c10c9554c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:15.362918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ba70bdeefd4412a819b99c10c9554c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:15.409732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ba70bdeefd4412a819b99c10c9554c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:15.434446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 886/1774] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:15 2022] DELETE /identity/v3/users/41ba70bdeefd4412a819b99c10c9554c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:15.438941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:15.439501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:15.439812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:15.487946 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:15.489203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:15.621817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:15.623700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:15.697766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 889/1775] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:15.748728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:15.751070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:15.786218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1c56d-1e0e-4351-a0b7-ece1f6752abc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:15.800127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:15.803460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:15.804838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:15.805234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] PATH_INFO: `/v3/projects/f4fc468128a84688999ee9a764b112ab` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:15.810048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4fc468128a84688999ee9a764b112ab)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:15.819054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:15.941405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b59fd3e-8d7a-4e9b-a127-dd91013b9fb4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:15.985597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4fc468128a84688999ee9a764b112ab', 'request_id': 'req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:16.011733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4fc468128a84688999ee9a764b112ab', 'request_id': 'req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:16.027635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4fc468128a84688999ee9a764b112ab', 'request_id': 'req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:16.067765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] The token cache is being invalidate because project f4fc468128a84688999ee9a764b112ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:16.069058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:16.072934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-07dd5c33-02b0-41ba-8e37-4e3076a9dc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:16.081377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 887/1776] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:15 2022] DELETE /identity/v3/projects/f4fc468128a84688999ee9a764b112ab => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:16.082276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84d44-5291-4961-917f-3a92f23e9056 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.082957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84d44-5291-4961-917f-3a92f23e9056 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.084644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f84d44-5291-4961-917f-3a92f23e9056 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.088198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 888/1777] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:13:16 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:16.090761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95588-6e64-4e9f-81f4-206104f3f0ac None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.092155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95588-6e64-4e9f-81f4-206104f3f0ac None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.093495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95588-6e64-4e9f-81f4-206104f3f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.107903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.108855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.111428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.112569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.116006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:16.133052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-76e95588-6e64-4e9f-81f4-206104f3f0ac None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:16.136127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-76e95588-6e64-4e9f-81f4-206104f3f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:16.260789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.263784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9573f8-b6b2-4495-84e5-c9fa873f28ba service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.271823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 889/1778] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:16.279710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 890/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:16.286442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.286868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.287254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.334468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.334804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.335085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.343185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:16.345052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:16.360654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 890/1780] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:16.365455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.387254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:16.390540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:16.394940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884737b8-53e6-46b6-a68d-af1827844e2d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.414117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.415576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.415968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.416248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.417002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:16.417314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.426360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.481541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 891/1781] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:16.485891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.530385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8e144-9355-4b4c-a959-02d29693e6a0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.540169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.541305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.541783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.542323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.543198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.546917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 891/1782] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:13:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:16.549976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.614987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 892/1783] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:16 2022] POST /identity/v3/projects => generated 367 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:16.615939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.630731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b9a7b-1fca-49c7-a7df-e1c5b6055096 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.728458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.729429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.729807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.730040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.731736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.734773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.775326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 892/1784] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:16 2022] POST /identity/v3/users => generated 284 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:16.776653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.800101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67b91b3-cd19-454d-9654-4429a324efd7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.812799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.813948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.814199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.814799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.816322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.834324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.865520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.876550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 893/1785] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:16.880174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6698b26-8511-4c3f-a92f-5ad9dac229c2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.896192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.898080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.899171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.900129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:16.900904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:16.905682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:16.945074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:16.955287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 893/1786] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:16 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:16.969850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947142a-28bc-4fd8-9ec7-896250be798f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:16.985414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:16.986150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:16.986439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:16.986745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] PATH_INFO: `/v3/projects/087a282954fb4319af9c16b93538090f/users/13abebb45dab4f118c397f9d14683ac8/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.016722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=087a282954fb4319af9c16b93538090f, user_id=13abebb45dab4f118c397f9d14683ac8, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.021442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.022227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.023295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.045829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 894/1787] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:16 2022] PUT /identity/v3/projects/087a282954fb4319af9c16b93538090f/users/13abebb45dab4f118c397f9d14683ac8/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:17.047053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.049159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.158447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6c0fa-facf-4adf-a5db-96c3a014778f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.173164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03455fc6-4839-4430-a539-fdcd466f17d7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.192201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.193882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.194319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.194621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] PATH_INFO: `/v3/users/7989eff21e73436e938aeaf100c602f5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.196169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7989eff21e73436e938aeaf100c602f5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.198354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.283356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.284027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.284360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.286677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.299779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.301409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46416319-4498-45c0-8a06-80d613de1fd7 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.306660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7989eff21e73436e938aeaf100c602f5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.330048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7989eff21e73436e938aeaf100c602f5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.330899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7989eff21e73436e938aeaf100c602f5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.333643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7989eff21e73436e938aeaf100c602f5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.335536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 894/1788] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:17.337509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.340987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.342230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.361504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e9126094-8a83-4496-9c2a-5f1988ac0aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7989eff21e73436e938aeaf100c602f5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.386118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 895/1789] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:17 2022] DELETE /identity/v3/users/7989eff21e73436e938aeaf100c602f5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:17.387818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.388115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.388392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.411772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] MFA Rules not processed for user `13abebb45dab4f118c397f9d14683ac8`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:17.413397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.416592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:17.418475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.512424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 896/1790] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:17.526796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 895/1791] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:17.531318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.533236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.552087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f993c-e46b-4ebc-b72d-107fa7f37214 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.559078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.559929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.560274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.560610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.561483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.563822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.569406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.570904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.630321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 897/1792] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:17 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:17.637270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.689420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5bfca-1bad-49d9-a61b-c6b1e7d296a8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.749143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d7eeb-2ca1-4ef7-a50f-726221eca94f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.753943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.754655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.754943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.755212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.755904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.757953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.767692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.768720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.769000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.769367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.782692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 898/1793] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:17 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:13:17.782888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.782971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.783045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.784478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.793668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 896/1794] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:17.794485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.797697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2afc4-d58e-4eff-9b48-cc27189d7ed1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.802550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.803456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.803740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.804017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] PATH_INFO: `/v3/projects/6afec9c44f8045c89e19ee70a2b9a0b5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.806762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77577949-25ac-4dcd-b49a-272d9651c74f service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.808102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6afec9c44f8045c89e19ee70a2b9a0b5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.810154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.822217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.823117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.823394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.823671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.824403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.826010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.844002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 897/1795] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:17.845129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.862775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63203218-26ab-4708-8c6d-69043b01bc50 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.883805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6afec9c44f8045c89e19ee70a2b9a0b5', 'request_id': 'req-3fc2d3da-d93a-40e8-89a9-d5164e465193'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.892334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6afec9c44f8045c89e19ee70a2b9a0b5', 'request_id': 'req-3fc2d3da-d93a-40e8-89a9-d5164e465193'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.902238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6afec9c44f8045c89e19ee70a2b9a0b5', 'request_id': 'req-3fc2d3da-d93a-40e8-89a9-d5164e465193'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.933352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] The token cache is being invalidate because project 6afec9c44f8045c89e19ee70a2b9a0b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:17.933987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.935063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:17.938645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 899/1796] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:17 2022] DELETE /identity/v3/projects/6afec9c44f8045c89e19ee70a2b9a0b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:17.945189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:17.948549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:17.950803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.951992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.952428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.952716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] PATH_INFO: `/v3/projects/deec0f942d2647929431515b53f084dc/users/f9df3e1466704ab7b3b1a0fb5ad7f085/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.978069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc2d3da-d93a-40e8-89a9-d5164e465193 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:17.984370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:17.986416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] RBAC: Authorizing `identity:create_grant(project_id=deec0f942d2647929431515b53f084dc, user_id=f9df3e1466704ab7b3b1a0fb5ad7f085, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.988207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:17.988536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:17.988819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] PATH_INFO: `/v3/users/3cf3fb84d771475db4829cf927810f49` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:17.991157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:17.991588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf3fb84d771475db4829cf927810f49)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:17.994724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.019430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 898/1797] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:17 2022] PUT /identity/v3/projects/deec0f942d2647929431515b53f084dc/users/f9df3e1466704ab7b3b1a0fb5ad7f085/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:18.022676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:18.027061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.079058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf3fb84d771475db4829cf927810f49'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:18.098989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf3fb84d771475db4829cf927810f49'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:18.099854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf3fb84d771475db4829cf927810f49'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:18.100566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf3fb84d771475db4829cf927810f49'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:18.114208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf3fb84d771475db4829cf927810f49'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:18.131507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a80341-79dc-49ea-91da-1e6c355a19be admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:18.140226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 900/1798] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:17 2022] DELETE /identity/v3/users/3cf3fb84d771475db4829cf927810f49 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:18.143890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:18.144723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.145082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.145437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.146256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:18.148020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16629aa4-2a1e-4b6b-9cba-7ab814901532 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.160664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 899/1799] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:18.164455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:18.166878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.243931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9bec7c-906c-4dab-9192-a4e04113d0a2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:18.249253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:18.250265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.250677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.251424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] PATH_INFO: `/v3/projects/deec0f942d2647929431515b53f084dc/users/f9df3e1466704ab7b3b1a0fb5ad7f085/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.253178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] RBAC: Authorizing `identity:create_grant(project_id=deec0f942d2647929431515b53f084dc, user_id=f9df3e1466704ab7b3b1a0fb5ad7f085, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:18.256007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.268892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 901/1800] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:18 2022] PUT /identity/v3/projects/deec0f942d2647929431515b53f084dc/users/f9df3e1466704ab7b3b1a0fb5ad7f085/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:18.279395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.279689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.279972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.312234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] MFA Rules not processed for user `f9df3e1466704ab7b3b1a0fb5ad7f085`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:18.313857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.538634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 900/1801] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:18 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:18.550981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:18.553467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.624127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91a9ab-634e-4726-a340-ed88d8b1871d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:18.629075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:18.629848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.630199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.630544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.642496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:18.644391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.658404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 902/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:18 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:18.798540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:18.800814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.804541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:18.815321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29435e7d-bf6f-464d-9c98-12b32d48235d service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:18.825967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:18.826815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.827102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.827378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.840964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:18.929840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d9437-388d-4fdc-91c9-be8fa677f42a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:18.936347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:18.937607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:18.938051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:18.938480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] PATH_INFO: `/v3/projects/6be48105c9e344d4bd9ee8e2506c0408` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:18.940074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6be48105c9e344d4bd9ee8e2506c0408)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:18.941975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.963614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:18.965602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:18.996985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 903/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:19.006129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6be48105c9e344d4bd9ee8e2506c0408', 'request_id': 'req-aef66a3c-5679-4f66-8c32-51168a680f62'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.014986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6be48105c9e344d4bd9ee8e2506c0408', 'request_id': 'req-aef66a3c-5679-4f66-8c32-51168a680f62'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.024306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6be48105c9e344d4bd9ee8e2506c0408', 'request_id': 'req-aef66a3c-5679-4f66-8c32-51168a680f62'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.038048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] The token cache is being invalidate because project 6be48105c9e344d4bd9ee8e2506c0408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:19.038374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.039147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-aef66a3c-5679-4f66-8c32-51168a680f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.042273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 901/1804] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:18 2022] DELETE /identity/v3/projects/6be48105c9e344d4bd9ee8e2506c0408 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:19.046061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:19.068212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f7686-c4ec-4811-984a-82174f5b66e4 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:19.269526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:19.270814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:19.272758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:19.273253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] PATH_INFO: `/v3/users/27449989259743d6a6b1d0fce9f22b27` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:19.278754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27449989259743d6a6b1d0fce9f22b27)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:19.282670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:19.415781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27449989259743d6a6b1d0fce9f22b27'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.475513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27449989259743d6a6b1d0fce9f22b27'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.476840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27449989259743d6a6b1d0fce9f22b27'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.478392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27449989259743d6a6b1d0fce9f22b27'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.522660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5df26e1a-04b5-4c5d-b034-c525cb094244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27449989259743d6a6b1d0fce9f22b27'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:19.572506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 904/1805] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:19 2022] DELETE /identity/v3/users/27449989259743d6a6b1d0fce9f22b27 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:19.664696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:19.665790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:19.666458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:19.668450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 902/1806] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:13:19.943305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d681-842c-410b-a181-74494ffd66a3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:19.943653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d681-842c-410b-a181-74494ffd66a3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:19.943961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c03d681-842c-410b-a181-74494ffd66a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:19.960531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:19.971938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.003880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9c03d681-842c-410b-a181-74494ffd66a3 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:20.005841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9c03d681-842c-410b-a181-74494ffd66a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.147891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d35bb5-dd6b-4fcc-bb9e-c7b08118479f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.159357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.165315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.165909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.166275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] PATH_INFO: `/v3/projects/448e7483c4304fd4b51369bf7764e274` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.167979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448e7483c4304fd4b51369bf7764e274)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.170014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.173595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 905/1807] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:13:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:20.233310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448e7483c4304fd4b51369bf7764e274', 'request_id': 'req-551c7172-86a6-481f-8cb5-f45edbbacac8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:20.240920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448e7483c4304fd4b51369bf7764e274', 'request_id': 'req-551c7172-86a6-481f-8cb5-f45edbbacac8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:20.253829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448e7483c4304fd4b51369bf7764e274', 'request_id': 'req-551c7172-86a6-481f-8cb5-f45edbbacac8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:20.277071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] The token cache is being invalidate because project 448e7483c4304fd4b51369bf7764e274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:20.277071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:20.277951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-551c7172-86a6-481f-8cb5-f45edbbacac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:20.281643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 903/1808] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:19 2022] DELETE /identity/v3/projects/448e7483c4304fd4b51369bf7764e274 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:20.286796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.287274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.287364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.324097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:20.325322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.402188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 906/1809] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:20.411634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.411909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.412190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.433635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:20.434903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.446909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 904/1810] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:20.447901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.458491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e0581-664a-479f-948d-9d6c085ec35a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.466013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.467273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.467273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.467273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.468055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:20.468432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.470035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.484179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 907/1811] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:20.488792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.498812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7b38fa-6ceb-40ff-b917-1637b58cad8d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.506326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.507049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.507327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.507612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.508294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.510463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.537635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 905/1812] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:20 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:20.544729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.560327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fdf1a-17f8-4877-9eb4-daa16ff8d9fd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.667885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.668793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.669495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.669845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.670219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.670724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.672992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.674190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.715952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 908/1813] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:20 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:20.719722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.736332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049821d-d259-4aba-a482-0c2a154db2f8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.751738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.752439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.752819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.752979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.754075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.755713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.782827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 909/1814] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:20.784222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.807418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01580402-903f-43e1-9844-f32ba90c94f4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.818950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.819942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.820252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.820529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.821328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.827722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.867200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 910/1815] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:20.869679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:20.882535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06a3c5-1935-4caf-adc6-09f76c5508e2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.893216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dba27b-a9f2-4a80-b155-0e918986db3d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:20.899501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.902871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.903302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.904445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.908972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:20.909886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:20.910163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:20.910431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] PATH_INFO: `/v3/projects/5523413711f44f7b8c0606f098ae0cb8/users/a6c7aa2cc9a2490684bdafe59c7c53d4/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:20.918596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:20.953249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5523413711f44f7b8c0606f098ae0cb8, user_id=a6c7aa2cc9a2490684bdafe59c7c53d4, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.954468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:20.955944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d42a81-a7f2-4cec-aa42-49a27563739b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.956728 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:20.988843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 911/1816] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:20 2022] PUT /identity/v3/projects/5523413711f44f7b8c0606f098ae0cb8/users/a6c7aa2cc9a2490684bdafe59c7c53d4/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:21.001033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.002324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.002440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.017607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 906/1817] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:21.063020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] MFA Rules not processed for user `a6c7aa2cc9a2490684bdafe59c7c53d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:21.066777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:21.209983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 912/1818] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:21.218064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.239040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ec0dd-74da-45f5-a14d-86b1a644e88a service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:21.355221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:21.355895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.356180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.356458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.357191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:21.362965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:21.440909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.453676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 907/1819] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:21 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:21.460598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaa0579-7615-4dac-869c-ef3e51d4a80d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:21.512191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.513974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:21.564061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:21.565595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.567301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.567301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.567982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:21.571921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:21.609074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 913/1820] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:21 2022] POST /identity/v3/users => generated 300 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:21.611898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.623620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7c5e2-73dd-4666-857a-362cbdbcd0da admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:21.631160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:21.631993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.632380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.632800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.635571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:21.636399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:21.660891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 914/1821] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:21.662970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.677743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b80c3d-f1c9-4030-bf29-f48581d1fc19 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:21.684490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:21.685409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.685692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.685952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] PATH_INFO: `/v3/projects/10ee91f72d7546c19530d5c724db37d5/users/5dc3fe72c7914ee5af085390da47ec09/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.692663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7509e-125c-4d40-aa23-d2c62f60fd0f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:21.699132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:21.701413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.701413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.701873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] PATH_INFO: `/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.703280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdc2faf8bc845e88e85ebf21178a3c4)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:21.705635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:21.728067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ee91f72d7546c19530d5c724db37d5, user_id=5dc3fe72c7914ee5af085390da47ec09, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:21.754071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:21.780260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdc2faf8bc845e88e85ebf21178a3c4', 'request_id': 'req-54a1f005-d11a-4f96-8e8d-a274371256df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:21.787516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdc2faf8bc845e88e85ebf21178a3c4', 'request_id': 'req-54a1f005-d11a-4f96-8e8d-a274371256df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:21.793441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 915/1822] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:21 2022] PUT /identity/v3/projects/10ee91f72d7546c19530d5c724db37d5/users/5dc3fe72c7914ee5af085390da47ec09/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:21.794715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:21.799774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdc2faf8bc845e88e85ebf21178a3c4', 'request_id': 'req-54a1f005-d11a-4f96-8e8d-a274371256df'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:21.818413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] The token cache is being invalidate because project bcdc2faf8bc845e88e85ebf21178a3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:21.819392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:21.820510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-54a1f005-d11a-4f96-8e8d-a274371256df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:21.847868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 908/1823] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:21 2022] DELETE /identity/v3/projects/bcdc2faf8bc845e88e85ebf21178a3c4 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:21.853309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79887-84ec-45eb-bf80-3abf7e0bab73 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:21.854004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79887-84ec-45eb-bf80-3abf7e0bab73 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:21.854004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e79887-84ec-45eb-bf80-3abf7e0bab73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:21.913193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-30e79887-84ec-45eb-bf80-3abf7e0bab73 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:21.918275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-30e79887-84ec-45eb-bf80-3abf7e0bab73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:21.995176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2efc59a-ee52-4a1c-a666-5ca1b89eea6b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.000591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.001706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.002187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.002860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.003779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.005997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.021165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 916/1824] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:22.026202 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.028576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:22.031792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 909/1825] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:22.041793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.041793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.041793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.046397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222d3da-5f7d-44b2-8e65-fc5dd5dd9044 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.052296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.054033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.054530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.055059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] PATH_INFO: `/v3/projects/10ee91f72d7546c19530d5c724db37d5/users/5dc3fe72c7914ee5af085390da47ec09/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.059020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ee91f72d7546c19530d5c724db37d5, user_id=5dc3fe72c7914ee5af085390da47ec09, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.062338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd2cc1-483c-4797-9cee-8e7401ebc807 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.071995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:22.073439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:22.076674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 917/1826] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:22 2022] PUT /identity/v3/projects/10ee91f72d7546c19530d5c724db37d5/users/5dc3fe72c7914ee5af085390da47ec09/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:22.090975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.091684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.091684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.148300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] MFA Rules not processed for user `5dc3fe72c7914ee5af085390da47ec09`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:22.151420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:22.160477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 910/1827] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:22.161430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.173734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ce2e2-22dc-4824-891d-702bce2ef38c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.179706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.180943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.181371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.181646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.182617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:22.182906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.184781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.205691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 911/1828] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:22.207566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.221322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bf9da-4215-49ed-85f0-a29d563d76a8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.232743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.234379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.234691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.235623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.237725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.242320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.285749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 918/1829] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:22.295209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 912/1830] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/projects => generated 367 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:22.296457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.302651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.306813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:22.308845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a06ea-c0af-4c12-b72c-cbf171bdc76b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.412177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.423054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.423699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.424074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.427466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.429775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.433281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c110eff-3568-4c09-b4da-4868eaefffdc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.443300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.443989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.444275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.444548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.475996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 919/1831] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/users => generated 284 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:22.481946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.492483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23d52b-4ed9-49b8-8eb9-c2f7abdaef1a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.499011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.500369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.501788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.501788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.503029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.504807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.543771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 920/1832] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:22.545423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.564739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.566205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.583771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f915c5a-74d8-42bc-9775-78ae31da4cd7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.592715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.595513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.595808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.596145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.596869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.598451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ccf9-8dd9-47c9-9c4e-75ae8dea8d6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.609807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 913/1833] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:22 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:22.617498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 921/1834] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:22.621986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:22.641682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e24c4f-08e8-4428-8ae2-e48192c0566b service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:22.648171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:22.649379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.650042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.650420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] PATH_INFO: `/v3/projects/33d3633dcf6a45d2a17da67affc19064/users/981feb9875844de09a918506549aa5de/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.724595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33d3633dcf6a45d2a17da67affc19064, user_id=981feb9875844de09a918506549aa5de, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:22.731283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:22.751482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 914/1835] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:22 2022] PUT /identity/v3/projects/33d3633dcf6a45d2a17da67affc19064/users/981feb9875844de09a918506549aa5de/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:22.762082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:22.762517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:22.762924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:22.806503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] MFA Rules not processed for user `981feb9875844de09a918506549aa5de`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:22.807743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:22.934632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 922/1836] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:22.936878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.044784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.065237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b54b0-04ce-44be-a4b4-29668ffe3bc6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.069774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6657975-a4c4-49ad-ab9b-cbb943105bd6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.076001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.077925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.078262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.078402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.079236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.079349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] PATH_INFO: `/v3/users/a6c7aa2cc9a2490684bdafe59c7c53d4` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.079748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.080766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.081619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.082183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c7aa2cc9a2490684bdafe59c7c53d4)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.084235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.084764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.128560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 915/1837] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:22 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:13:23.133043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.190507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c7aa2cc9a2490684bdafe59c7c53d4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:23.222379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c7aa2cc9a2490684bdafe59c7c53d4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:23.223233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c7aa2cc9a2490684bdafe59c7c53d4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:23.229653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c7aa2cc9a2490684bdafe59c7c53d4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:23.256712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c60cbf6-7a22-4730-9807-84fd96bb3295 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c7aa2cc9a2490684bdafe59c7c53d4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:23.290316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 923/1838] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:23 2022] DELETE /identity/v3/users/a6c7aa2cc9a2490684bdafe59c7c53d4 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:23.292306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.292626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.292908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.333934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:23.335174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880643d7-9df3-4b15-bfdb-61980cc24455 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.337711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:23.474810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.475514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.475800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.476206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.477012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.480801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.492760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 924/1839] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:23.523890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 916/1840] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:23 2022] POST /identity/v3/users => generated 289 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:23.524222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.525664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.526706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:23.527870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:23.545757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9316f425-a738-47c9-b868-bb8e776409e6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.553210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.554021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.554272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.554641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.556114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.559132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.574554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 917/1841] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:23.580195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.593053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4d4081-2b34-4b90-818c-6be8f740e11b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.599643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.600865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.601145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.601415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] PATH_INFO: `/v3/projects/ca85fb6faf324108b4870dad1d93b564/users/285e02b566ae4e0b8de883950e8dee41/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.632242 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca85fb6faf324108b4870dad1d93b564, user_id=285e02b566ae4e0b8de883950e8dee41, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.635898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.662161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 918/1842] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:23 2022] PUT /identity/v3/projects/ca85fb6faf324108b4870dad1d93b564/users/285e02b566ae4e0b8de883950e8dee41/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:23.666701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.670152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785a0d7-6c01-44b3-bb05-651e17a1f5c7 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.794002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39e2fa-b599-400e-8ddc-8981ce537745 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.797460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.798940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.799938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.801107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.801482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.802114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.802738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.803162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.804991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.807965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.821072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.821765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 919/1843] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:23 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:23.827361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:23.831955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60528fe9-8f0b-48cd-97bf-b66c9452c6dc service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.843450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f015c4-12aa-4424-93b3-f00b1925f232 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:23.853339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:23.854256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.855055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.855350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] PATH_INFO: `/v3/projects/ca85fb6faf324108b4870dad1d93b564/users/285e02b566ae4e0b8de883950e8dee41/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.857791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca85fb6faf324108b4870dad1d93b564, user_id=285e02b566ae4e0b8de883950e8dee41, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:23.860708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:23.876489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 925/1844] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:23.892284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 920/1845] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:23 2022] PUT /identity/v3/projects/ca85fb6faf324108b4870dad1d93b564/users/285e02b566ae4e0b8de883950e8dee41/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:23.894413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:23.894762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:23.895038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:23.943442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] MFA Rules not processed for user `285e02b566ae4e0b8de883950e8dee41`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:23.948596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:24.091708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 926/1846] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:24.104274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:24.106305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:24.187610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008911f-05fc-4e6d-9a2b-b429cf17f8be admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:24.193761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:24.195117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:24.196001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:24.196001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:24.207186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:24.208925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:24.223042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 921/1847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:24.569774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:24.572060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:24.644557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e14e845-982e-41f7-9e3b-c3a06af73fbf None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:24.653106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:24.654381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:24.654819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:24.655193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] PATH_INFO: `/v3/projects/5523413711f44f7b8c0606f098ae0cb8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:24.656529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5523413711f44f7b8c0606f098ae0cb8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:24.659376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:24.716552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5523413711f44f7b8c0606f098ae0cb8', 'request_id': 'req-f97a99a6-3da2-493d-9ce9-483c7d804f0e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.723131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5523413711f44f7b8c0606f098ae0cb8', 'request_id': 'req-f97a99a6-3da2-493d-9ce9-483c7d804f0e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.732522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5523413711f44f7b8c0606f098ae0cb8', 'request_id': 'req-f97a99a6-3da2-493d-9ce9-483c7d804f0e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.744514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] The token cache is being invalidate because project 5523413711f44f7b8c0606f098ae0cb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:24.744908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.745652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.747447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 927/1848] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:24 2022] DELETE /identity/v3/projects/5523413711f44f7b8c0606f098ae0cb8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:24.753275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:24.807488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b4ca6-f34c-4efd-85c0-9b5c0d0b68fd service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:24.906605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:24.907145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:24.907534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:24.907991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] PATH_INFO: `/v3/users/5dc3fe72c7914ee5af085390da47ec09` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:24.909757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc3fe72c7914ee5af085390da47ec09)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:24.911949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:24.962435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc3fe72c7914ee5af085390da47ec09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.983657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc3fe72c7914ee5af085390da47ec09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.984391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc3fe72c7914ee5af085390da47ec09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:24.991477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc3fe72c7914ee5af085390da47ec09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.001485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc3fe72c7914ee5af085390da47ec09'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.012450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 922/1849] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:24 2022] DELETE /identity/v3/users/5dc3fe72c7914ee5af085390da47ec09 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:25.396658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.398560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.419732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a99a6-3da2-493d-9ce9-483c7d804f0e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:25.513338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:25.514917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.515291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.515601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] PATH_INFO: `/v3/users/13abebb45dab4f118c397f9d14683ac8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.516926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13abebb45dab4f118c397f9d14683ac8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:25.518928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:25.551512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.551512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.576168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20e546-d47e-4688-bbb9-5d9aa2c60e4e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:25.585787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:25.587171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.587640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13abebb45dab4f118c397f9d14683ac8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.588223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.588858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] PATH_INFO: `/v3/projects/10ee91f72d7546c19530d5c724db37d5` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.590733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ee91f72d7546c19530d5c724db37d5)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:25.593097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:25.622865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13abebb45dab4f118c397f9d14683ac8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.623627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13abebb45dab4f118c397f9d14683ac8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.624280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13abebb45dab4f118c397f9d14683ac8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.642833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4366e83b-dbaf-438b-9667-eee799037dc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13abebb45dab4f118c397f9d14683ac8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.668169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 928/1850] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:25 2022] DELETE /identity/v3/users/13abebb45dab4f118c397f9d14683ac8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:25.670349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.670888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.671400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.693574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:25.695177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.722790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ee91f72d7546c19530d5c724db37d5', 'request_id': 'req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.736591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ee91f72d7546c19530d5c724db37d5', 'request_id': 'req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.748132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ee91f72d7546c19530d5c724db37d5', 'request_id': 'req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.763781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] The token cache is being invalidate because project 10ee91f72d7546c19530d5c724db37d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:25.764399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.764999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c8b14d7f-46f7-4fb2-8275-6cce519c7ab2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:25.766526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 923/1851] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:25 2022] DELETE /identity/v3/projects/10ee91f72d7546c19530d5c724db37d5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:25.771659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7676-1898-44e1-bb12-44e1bfc6a1c4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.771952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7676-1898-44e1-bb12-44e1bfc6a1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.772233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e7676-1898-44e1-bb12-44e1bfc6a1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.796693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a07e7676-1898-44e1-bb12-44e1bfc6a1c4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:25.798116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a07e7676-1898-44e1-bb12-44e1bfc6a1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.815138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 929/1852] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:25.826026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.828326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.878924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 924/1853] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:25.886615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.887109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.887385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.909511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:25.910993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.928280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 925/1854] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:25.931770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c4f69e-076d-430f-97eb-b687bb0d2820 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:25.933153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.935499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:25.936160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.936442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.936718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.943580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab795-6341-4c10-8b26-3efe6ac63345 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:25.951097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:25.951532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:25.951805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.952087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.952361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.952954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:25.953087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:25.953550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:25.955320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:25.963514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 930/1855] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:25.964349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.965808 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:25.972151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 926/1856] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:25.975795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:25.981595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f9dc9b-67ca-475b-86aa-045a4a042f87 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:25.986881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:25.988027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:25.988562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:25.989254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] PATH_INFO: `/v3/users/981feb9875844de09a918506549aa5de` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:25.990601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=981feb9875844de09a918506549aa5de)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:25.992677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:25.997290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad23d5-a8fe-4477-b3da-f2b7e6ad8b33 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.003454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.004579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.005109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.005109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.005803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.007960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.052838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 927/1857] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:25 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:26.053898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.055194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '981feb9875844de09a918506549aa5de'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.072919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '981feb9875844de09a918506549aa5de'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.074138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '981feb9875844de09a918506549aa5de'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.074974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '981feb9875844de09a918506549aa5de'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.085974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f1397864-6635-458d-bd98-9c4c2409b819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '981feb9875844de09a918506549aa5de'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.109684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 931/1858] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:25 2022] DELETE /identity/v3/users/981feb9875844de09a918506549aa5de => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:26.111761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.112054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.112335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.132503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:26.134304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.161485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f97ea-ae1d-40e9-9972-dbe3e8c3eef9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.247986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 932/1859] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:26.252764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.255652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.256000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.256285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.257007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.259484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.261140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.262737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.297800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 928/1860] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:26 2022] POST /identity/v3/users => generated 287 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:26.301373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.305957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.320732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c5313-033e-422c-8044-8c51f4cf932e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.328517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.329279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.329657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.330446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.331170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.333794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.347484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea2e14e-99ed-4e3f-8bd1-812deaa353fd None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.349943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 929/1861] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:26.354505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.355288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.355654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.356001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.356389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.368446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.368619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2569665-8c21-434a-94a5-2678bd884c41 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.370261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.375579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.376735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.376735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.377145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.378546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.380737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.382364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 933/1862] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:13:26.406822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 930/1863] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:26.409592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.422381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccab506-2569-499b-9b1a-a8a5f3ff7be1 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.434970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.434970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.434970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.434970 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] PATH_INFO: `/v3/projects/82392a2365e445fba8180c0b0c8879e6/users/d80f9988a39f4b1391b2bb7ed134bd35/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.459904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82392a2365e445fba8180c0b0c8879e6, user_id=d80f9988a39f4b1391b2bb7ed134bd35, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.463580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d80a3-aa32-494b-919e-6e63dd979389 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.463944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.465812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.480892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8939f022-78cf-4845-bd60-92abf5a0224e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.488125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 934/1864] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:26 2022] PUT /identity/v3/projects/82392a2365e445fba8180c0b0c8879e6/users/d80f9988a39f4b1391b2bb7ed134bd35/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:26.500009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.500366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.500647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.534410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] MFA Rules not processed for user `d80f9988a39f4b1391b2bb7ed134bd35`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:26.535762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.545876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.546861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.547144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.547417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] PATH_INFO: `/v3/projects/087a282954fb4319af9c16b93538090f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.548832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=087a282954fb4319af9c16b93538090f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.551675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.621676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '087a282954fb4319af9c16b93538090f', 'request_id': 'req-70d7084e-93b1-4516-b9bd-37ac64ae7c90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.625628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 935/1865] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:26.636045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '087a282954fb4319af9c16b93538090f', 'request_id': 'req-70d7084e-93b1-4516-b9bd-37ac64ae7c90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.638952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.640014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.646847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '087a282954fb4319af9c16b93538090f', 'request_id': 'req-70d7084e-93b1-4516-b9bd-37ac64ae7c90'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.662029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] The token cache is being invalidate because project 087a282954fb4319af9c16b93538090f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:26.662898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.663305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.665861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 931/1866] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:26 2022] DELETE /identity/v3/projects/087a282954fb4319af9c16b93538090f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:26.678821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.683512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.731647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb32dca-2c04-4893-92a4-e58863087aca None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.758843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d7084e-93b1-4516-b9bd-37ac64ae7c90 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.763622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.764501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.764920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.765470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] PATH_INFO: `/v3/users/f9df3e1466704ab7b3b1a0fb5ad7f085` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.766407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9df3e1466704ab7b3b1a0fb5ad7f085)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.768358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.782153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.782881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.783164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.783440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.785310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.822616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9df3e1466704ab7b3b1a0fb5ad7f085'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.839390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9df3e1466704ab7b3b1a0fb5ad7f085'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.840177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9df3e1466704ab7b3b1a0fb5ad7f085'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.847183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9df3e1466704ab7b3b1a0fb5ad7f085'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.856394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.856995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9df3e1466704ab7b3b1a0fb5ad7f085'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:26.858841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:26.868416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 932/1867] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:26 2022] DELETE /identity/v3/users/f9df3e1466704ab7b3b1a0fb5ad7f085 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:26.869249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:26.869482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 936/1868] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:26.871579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:26.974784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab45ed-b522-44e9-9d62-49669e855f70 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:26.981570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:26.982753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:26.982950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:26.983255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] PATH_INFO: `/v3/projects/33d3633dcf6a45d2a17da67affc19064` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:26.984965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33d3633dcf6a45d2a17da67affc19064)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:26.987026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:27.056902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33d3633dcf6a45d2a17da67affc19064', 'request_id': 'req-5aee54f2-4946-468e-871c-517d4a2bafd0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.069673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33d3633dcf6a45d2a17da67affc19064', 'request_id': 'req-5aee54f2-4946-468e-871c-517d4a2bafd0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.082234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33d3633dcf6a45d2a17da67affc19064', 'request_id': 'req-5aee54f2-4946-468e-871c-517d4a2bafd0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.106206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] The token cache is being invalidate because project 33d3633dcf6a45d2a17da67affc19064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:27.106918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.108028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.114759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 933/1869] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:26 2022] DELETE /identity/v3/projects/33d3633dcf6a45d2a17da67affc19064 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:27.115983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:27.117606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:27.131907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e51ff-aa23-4752-b605-498702e158a0 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:27.223833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:27.225645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:27.252290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:27.253248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.253604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.253939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] PATH_INFO: `/v3/users/285e02b566ae4e0b8de883950e8dee41` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.255538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285e02b566ae4e0b8de883950e8dee41)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:27.258983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:27.363606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee54f2-4946-468e-871c-517d4a2bafd0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:27.372558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285e02b566ae4e0b8de883950e8dee41'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.376043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:27.377028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.377424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.377880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] PATH_INFO: `/v3/projects/deec0f942d2647929431515b53f084dc` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.379125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=deec0f942d2647929431515b53f084dc)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:27.381519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:27.387993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285e02b566ae4e0b8de883950e8dee41'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.389310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285e02b566ae4e0b8de883950e8dee41'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.390085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285e02b566ae4e0b8de883950e8dee41'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.400770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f59bad10-ed89-4201-a0c4-e420cef9f3f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285e02b566ae4e0b8de883950e8dee41'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.416182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 937/1870] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:27 2022] DELETE /identity/v3/users/285e02b566ae4e0b8de883950e8dee41 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:27.485915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deec0f942d2647929431515b53f084dc', 'request_id': 'req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.503937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deec0f942d2647929431515b53f084dc', 'request_id': 'req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.513301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deec0f942d2647929431515b53f084dc', 'request_id': 'req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.532423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] The token cache is being invalidate because project deec0f942d2647929431515b53f084dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:27.532713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.534362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-669018a6-7463-4c0d-9ed5-3ee1cd359fe8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:27.547664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 934/1871] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:27 2022] DELETE /identity/v3/projects/deec0f942d2647929431515b53f084dc => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:27.549999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.550310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.550646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.591189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:27.592949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:27.700729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 938/1872] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:27.709567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.710177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.710177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.742368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:27.744717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:27.756287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 935/1873] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:27.761047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:27.774254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5fb1a7-0ac2-49c1-9902-c5f5107ac365 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:27.788626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:27.788626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.788950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.789187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.790514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:27.791274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:27.792387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:27.827859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 939/1874] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:27.830112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:27.841697 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68420bb5-c0dc-4e97-b27e-601ebdde610d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:27.846884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:27.847562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:27.847845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:27.848120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:27.848819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:27.852139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:27.884670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 936/1875] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:27 2022] POST /identity/v3/projects => generated 385 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:27.888493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:27.908348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691835f8-796b-4ee6-bdef-5a9e360c1eb2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.035150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.036800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.037311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.037831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.038751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.041691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.069964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 940/1876] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:27 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:28.074641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.090440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5cee9-d1f8-48ba-811c-261e89dc7775 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.095284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.096061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.096412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.096759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.097486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.099510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.123918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 937/1877] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:28.128891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.161956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a050d5-13b7-4f03-b5b5-16648a579a57 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.173002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.183523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:28.222923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.229389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.230213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.234266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.235085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.237154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.238561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29b04a-590f-43d3-bbd9-b19888cfcf09 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.251514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.252402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.252684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.252961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] PATH_INFO: `/v3/projects/ca85fb6faf324108b4870dad1d93b564` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.254405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca85fb6faf324108b4870dad1d93b564)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.256660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.265954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 941/1878] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:28.266883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.286772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a4c90a-0d24-453e-bbbe-2234640dba0c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.295554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.296615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.296900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.297173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] PATH_INFO: `/v3/projects/1c3473a621a54a13ba9b934bcb689343/users/fad8eae9bf784378a5fc3f5c0b03b39f/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.315388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c3473a621a54a13ba9b934bcb689343, user_id=fad8eae9bf784378a5fc3f5c0b03b39f, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.320389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca85fb6faf324108b4870dad1d93b564', 'request_id': 'req-ccfb568b-bd33-41f9-bdad-633991ed7535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:28.322417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b03c15-ccd4-4733-b366-1c9baeb45a81 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.327860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca85fb6faf324108b4870dad1d93b564', 'request_id': 'req-ccfb568b-bd33-41f9-bdad-633991ed7535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:28.339941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca85fb6faf324108b4870dad1d93b564', 'request_id': 'req-ccfb568b-bd33-41f9-bdad-633991ed7535'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:28.357644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 942/1879] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:28 2022] PUT /identity/v3/projects/1c3473a621a54a13ba9b934bcb689343/users/fad8eae9bf784378a5fc3f5c0b03b39f/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:28.357880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] The token cache is being invalidate because project ca85fb6faf324108b4870dad1d93b564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:28.357880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:28.357880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ccfb568b-bd33-41f9-bdad-633991ed7535 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:28.360085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.360313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 938/1880] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:28 2022] DELETE /identity/v3/projects/ca85fb6faf324108b4870dad1d93b564 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:28.360540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.360839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.364711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ef47-f0a5-40f7-8681-729fc5a4c2cf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.364998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ef47-f0a5-40f7-8681-729fc5a4c2cf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.365271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026ef47-f0a5-40f7-8681-729fc5a4c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.418669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] MFA Rules not processed for user `fad8eae9bf784378a5fc3f5c0b03b39f`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:28.420209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:28.428005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d026ef47-f0a5-40f7-8681-729fc5a4c2cf None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:28.429217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d026ef47-f0a5-40f7-8681-729fc5a4c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:28.557762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 939/1881] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:28.560908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.560908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.561420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.563901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 943/1882] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:28.580082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:28.581818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:28.591587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 940/1883] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:28.595995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.613939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b3df5-ee96-47f1-b48d-bb022cbb5285 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.619875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.620593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.620852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.621174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.622195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:28.622695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.624328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.628485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.629933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:28.640308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 944/1884] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:13:28.644558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.655414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e158d060-88af-483e-8574-99ada5d37112 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.660409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.661061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.661349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.661621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.662328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.664271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.690242 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154905d0-db97-4942-b1b0-346e7de7859f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.694157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 945/1885] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:13:28.695167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.695926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.696894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.697197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.698620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.706590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.708176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.721895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 941/1886] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:28.766001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee7b79-f7db-4799-a7c9-e62e87fc335d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.771216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.771895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.772194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.772473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.773154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.775177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.797098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 946/1887] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:28.801024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.813771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57c36f-9deb-46cc-a22c-1e914388de62 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.819576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.820244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.820527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.820857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.822348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.825489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.838881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 942/1888] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:28.840005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.850030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b986d1d6-cecb-4bb2-8670-adb9782526a9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.862511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.863314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.863622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.863928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.864737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.866293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c4fbc3-9ae1-4c68-9274-003d2846d9f9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.882624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 947/1889] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:28.885056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:28.903791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811f37b5-1008-4bda-a39c-709730ba01c3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:28.909840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:28.912294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.912841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.913206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] PATH_INFO: `/v3/projects/0c9be18b8d1d4ac0b589db856d29163a/users/191eed708fe2444fa9dd84d0ef9772e4/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:28.939535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c9be18b8d1d4ac0b589db856d29163a, user_id=191eed708fe2444fa9dd84d0ef9772e4, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:28.945806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:28.962236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 943/1890] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:28 2022] PUT /identity/v3/projects/0c9be18b8d1d4ac0b589db856d29163a/users/191eed708fe2444fa9dd84d0ef9772e4/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:28.973658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:28.973842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:28.974033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.031734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] MFA Rules not processed for user `191eed708fe2444fa9dd84d0ef9772e4`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:29.034722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:29.159709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 948/1891] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:29.161413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.304590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bff65b-a98e-48a4-b77b-2bc783f5994f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.323827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.324668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.324945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.325230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.325930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.327879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.361521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 944/1892] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:29.365974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.378272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6620b4-7a95-4274-a9e7-a0a4b9cbdffe None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.488733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.489845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.490295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.490703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.491526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.494608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.519561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 949/1893] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:29 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:29.525044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.535987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c46599-2263-4464-881d-bcc308befdb5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.543066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.543992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.544451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.544951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.545841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.548033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.560161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 945/1894] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:29.564334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.584197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6cb98-7f87-4720-8736-4339d7230507 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.590589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.591721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.591999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.592272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] PATH_INFO: `/v3/projects/0c356b73cdf24621be619e381873bea6/users/f1be9baf38c74461b81fbc14d8a5a26d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.611333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c356b73cdf24621be619e381873bea6, user_id=f1be9baf38c74461b81fbc14d8a5a26d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.614918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.648724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 950/1895] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:29 2022] PUT /identity/v3/projects/0c356b73cdf24621be619e381873bea6/users/f1be9baf38c74461b81fbc14d8a5a26d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:29.653123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.663303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef00f5-1061-4916-a45d-d6ee1c056d1b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.727811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.728493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.728772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.729040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.729867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.731846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb5cd98-0191-4693-a03c-bfb446e2ba8f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.743473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 946/1896] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:29.748199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.760836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b167912-bc68-44b3-82c1-8fe5396494fc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.766372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.767608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.767961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.768307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] PATH_INFO: `/v3/projects/0c356b73cdf24621be619e381873bea6/users/f1be9baf38c74461b81fbc14d8a5a26d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.770675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c356b73cdf24621be619e381873bea6, user_id=f1be9baf38c74461b81fbc14d8a5a26d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:29.773262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:29.789111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 951/1897] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:29 2022] PUT /identity/v3/projects/0c356b73cdf24621be619e381873bea6/users/f1be9baf38c74461b81fbc14d8a5a26d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:29.800226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.800596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.800936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:29.829818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] MFA Rules not processed for user `f1be9baf38c74461b81fbc14d8a5a26d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:29.831181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:29.903724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 947/1898] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:29 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:29.915551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:29.984263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cedc2-1460-4515-b994-7078403e4f86 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:29.988196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:29.989089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:29.989475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:29.989857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:30.064760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:30.066517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1223cd-8591-4f07-95b3-a6d6551cd1b6 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:30.079428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 952/1899] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:30.436952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:30.438541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:30.565980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724e326-ea68-4a44-96d0-17f2c128ca8c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:30.572356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:30.574741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:30.575420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:30.575898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] PATH_INFO: `/v3/users/d80f9988a39f4b1391b2bb7ed134bd35` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:30.577771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d80f9988a39f4b1391b2bb7ed134bd35)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:30.580920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:30.659943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd80f9988a39f4b1391b2bb7ed134bd35'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:30.678130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd80f9988a39f4b1391b2bb7ed134bd35'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:30.678923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd80f9988a39f4b1391b2bb7ed134bd35'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:30.686335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd80f9988a39f4b1391b2bb7ed134bd35'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:30.695179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd80f9988a39f4b1391b2bb7ed134bd35'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:30.706397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 948/1900] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:30 2022] DELETE /identity/v3/users/d80f9988a39f4b1391b2bb7ed134bd35 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:30.708146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627c71-5364-4e69-923c-074d8161fede None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:30.708450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627c71-5364-4e69-923c-074d8161fede None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:30.708736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f627c71-5364-4e69-923c-074d8161fede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:30.726900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4f627c71-5364-4e69-923c-074d8161fede None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:30.728644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4f627c71-5364-4e69-923c-074d8161fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:30.787951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 953/1901] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:13:30.800542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:30.802021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:30.859886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1517e44-7645-42f4-9954-e7dda9690dd0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:30.863701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:30.864355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:30.864699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:30.865010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:30.874919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:30.876368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b9280-64d8-438e-9ffc-a0cc72af0e68 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:30.886015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 949/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:31.197163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f627c71-5364-4e69-923c-074d8161fede None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.198780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4f627c71-5364-4e69-923c-074d8161fede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:31.213614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f627c71-5364-4e69-923c-074d8161fede None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.218263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.219160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.219441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.219710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] PATH_INFO: `/v3/projects/82392a2365e445fba8180c0b0c8879e6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.220894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82392a2365e445fba8180c0b0c8879e6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.223587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.268902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82392a2365e445fba8180c0b0c8879e6', 'request_id': 'req-bc2bcd40-8724-45f9-914c-bc057d75be4a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:31.274811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82392a2365e445fba8180c0b0c8879e6', 'request_id': 'req-bc2bcd40-8724-45f9-914c-bc057d75be4a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:31.282257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82392a2365e445fba8180c0b0c8879e6', 'request_id': 'req-bc2bcd40-8724-45f9-914c-bc057d75be4a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:31.293758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] The token cache is being invalidate because project 82392a2365e445fba8180c0b0c8879e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:31.294045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:31.294712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bc2bcd40-8724-45f9-914c-bc057d75be4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:31.296266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 954/1903] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:31 2022] DELETE /identity/v3/projects/82392a2365e445fba8180c0b0c8879e6 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:31.301142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.301432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.301737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.318923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:31.320106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:31.376771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 950/1904] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:31.385979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.386267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.386542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.405335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:31.406552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:31.414701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 955/1905] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:31.418789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.428491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6b43f-bfbe-4cc8-970f-7a2b083edb12 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.433224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.433880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.434165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.434444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.435209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:31.435522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.437111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.449202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 951/1906] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:31.453308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.462926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e079fe4-ec15-424a-a41e-36fad1e0abd1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.467462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.468102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.468381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.468650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.469328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.471225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.495476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 956/1907] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/projects => generated 383 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:31.499539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.514318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725d3b-1667-4dab-bf53-bdc5d1e04cc7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.575225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.575904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.576191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.576477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.577204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.579163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.599504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 952/1908] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:13:31.604720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.615085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bcb62-6b00-4dee-897a-13587a10dd15 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.619759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.620438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.620713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.620984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.621698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.623323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.634158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 957/1909] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:31.638185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.647968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ce53a-78ed-4cb7-967f-184d6de211bf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.653253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.653922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.654205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.654476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.655238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.656904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4c42c8-a018-419e-9ce7-ebc78dbe7e50 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.667168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 953/1910] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:31.671196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.681638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c2d7d-061f-4565-adac-225b5f0fc40e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.686629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.687606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.687781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.688056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] PATH_INFO: `/v3/projects/778dc663c7d54aa39bfbfd414e023110/users/34e71d5087ff488a83ee584302d673eb/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.704206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=778dc663c7d54aa39bfbfd414e023110, user_id=34e71d5087ff488a83ee584302d673eb, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.706806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.719515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 958/1911] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:31 2022] PUT /identity/v3/projects/778dc663c7d54aa39bfbfd414e023110/users/34e71d5087ff488a83ee584302d673eb/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:31.729787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.730081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.730363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.756842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] MFA Rules not processed for user `34e71d5087ff488a83ee584302d673eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:31.758040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:31.822882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 954/1912] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:31.827489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.889065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f521253-766d-4304-a2e1-0e1c9d7448d0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.893711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.894373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.894685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.894962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:31.895666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:31.897536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:31.925503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 959/1913] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:31.929364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:31.940791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06b4b-56f3-4169-9fc5-fe950eb1a04f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:31.998317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:31.999031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:31.999317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:31.999588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.000286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.002181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.021976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 955/1914] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:31 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:13:32.026882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.037294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e1fc48-8795-4aff-8e01-8870857d224c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.042804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.043488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.043769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.044049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.044777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.046375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.057510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 960/1915] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:32.061698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.072802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04ab5-057f-4535-a795-71211630a027 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.077598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.078368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.078751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.079032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.080165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.081418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eca6a0a-292c-4028-b2e8-e3882743860a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.092913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 956/1916] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:32.097421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.107776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427ca452-6bc8-4a3b-a5ed-6788bc6db000 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.113306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.114357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.114683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.114946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] PATH_INFO: `/v3/projects/08c92ea416d347abbed5654913aed6d8/users/2684662015c64ef9b418c0e9bf8fbf8a/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.130111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c92ea416d347abbed5654913aed6d8, user_id=2684662015c64ef9b418c0e9bf8fbf8a, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.133768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.149507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 961/1917] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:32 2022] PUT /identity/v3/projects/08c92ea416d347abbed5654913aed6d8/users/2684662015c64ef9b418c0e9bf8fbf8a/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:32.159407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.159699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.159982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.188812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] MFA Rules not processed for user `2684662015c64ef9b418c0e9bf8fbf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:32.190028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:32.253627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 957/1918] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:32.257980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.323505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f02d13-b8f8-46be-98c0-823144f613c9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.328118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.328774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.329050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.329319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.330011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.331937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.363304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 962/1919] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:32 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:32.364583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.376124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ba61e-fb1a-41c6-bef6-13a7e3bb2c36 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.434294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.435022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.435315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.435597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.436290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.438204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.457303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 958/1920] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:32 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:32.461227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.471581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd868a-11dc-4b14-ab17-1af251377693 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.476259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.476942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.477763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.478040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.478797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.480396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.490724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 963/1921] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:32.495466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.505384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d0cfb7-3da5-4587-8bbd-cec1e2317f28 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.510726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.511639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.511921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.512195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] PATH_INFO: `/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2/users/01451e889d894ce9b2aa2badbf45ab89/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.526240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e1f55cbb44cec9d64e1dba8dd49f2, user_id=01451e889d894ce9b2aa2badbf45ab89, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.528912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.540959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 959/1922] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:32 2022] PUT /identity/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2/users/01451e889d894ce9b2aa2badbf45ab89/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:32.544775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.554772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476ce7e-9c99-4c7b-9266-4dc9e78abaca admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.611635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.612364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.612643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.612911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.613651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.615297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0605d2-17e5-4ec9-b1de-e95b396c0def admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.624875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 964/1923] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:32.628886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.638714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a44a785-1151-4cad-98e5-9fd820d67b94 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.643229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.644099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.644375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.644645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] PATH_INFO: `/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2/users/01451e889d894ce9b2aa2badbf45ab89/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.646561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324e1f55cbb44cec9d64e1dba8dd49f2, user_id=01451e889d894ce9b2aa2badbf45ab89, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.649718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.659419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 960/1924] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:32 2022] PUT /identity/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2/users/01451e889d894ce9b2aa2badbf45ab89/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:32.671136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.671437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.671747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.698165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] MFA Rules not processed for user `01451e889d894ce9b2aa2badbf45ab89`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:32.699419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:32.769599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 965/1925] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:32.781397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:32.783125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:32.841537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04995f7-87d2-4f00-b719-35e37ebcc072 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:32.845374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:32.846032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:32.846318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:32.846620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:32.901688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:32.903164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:32.911893 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 961/1926] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:34.414140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:34.424480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12bdd6e-b57e-414f-8cb0-4e9f3bdf4044 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:34.429804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:34.431281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:34.431663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:34.432040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:34.492066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:34.494538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:34.504896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 966/1927] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:36.203116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:36.204587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:36.216784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a8a8-927e-4966-b06b-0d7af92d580e service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:36.220624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:36.221379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:36.221745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:36.222088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:36.232146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:36.233661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:36.243425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 962/1928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:36 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:37.959789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:37.973877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3afde7e-aa53-4ee9-9807-cda5588d8500 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:37.985112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:37.985793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:37.986079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:37.986355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:37.988243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:38.058416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:38.059882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9437c857-e69c-4e81-837a-a02d93a68464 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:38.072367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 967/1929] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:37 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:39.321428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:39.323004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:39.386181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0a788-903d-4884-92e0-66f97d37221c service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:39.390704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:39.391580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:39.391859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:39.392330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] PATH_INFO: `/v3/users/fad8eae9bf784378a5fc3f5c0b03b39f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:39.393515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad8eae9bf784378a5fc3f5c0b03b39f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:39.395482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:39.440843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad8eae9bf784378a5fc3f5c0b03b39f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:39.453855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad8eae9bf784378a5fc3f5c0b03b39f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:39.454558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad8eae9bf784378a5fc3f5c0b03b39f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:39.461854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad8eae9bf784378a5fc3f5c0b03b39f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:39.472286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad8eae9bf784378a5fc3f5c0b03b39f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:39.478539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 963/1930] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:39 2022] DELETE /identity/v3/users/fad8eae9bf784378a5fc3f5c0b03b39f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:39.483034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:39.483563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:39.483656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:39.501025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:39.502212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:39.560610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 968/1931] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:39.570802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:39.573035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:39.662128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30574bd3-94c7-4cfd-a5fa-6661a083c7fe admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:39.667306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:39.668037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:39.668315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:39.668585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:39.681717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:39.683723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73af5ef9-3c6f-4b0b-b1a5-c949ca8d78d8 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:39.695311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 964/1932] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:40.071586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.073250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:40.089824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c91bde-1fcd-47a0-ba13-930aa2b7d9e8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.095437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.096702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.097512 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.098124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] PATH_INFO: `/v3/projects/1c3473a621a54a13ba9b934bcb689343` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.099573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c3473a621a54a13ba9b934bcb689343)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.101725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.165801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c3473a621a54a13ba9b934bcb689343', 'request_id': 'req-806ceedc-401e-4642-a439-3e8b0a222373'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:40.171806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c3473a621a54a13ba9b934bcb689343', 'request_id': 'req-806ceedc-401e-4642-a439-3e8b0a222373'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:40.181186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c3473a621a54a13ba9b934bcb689343', 'request_id': 'req-806ceedc-401e-4642-a439-3e8b0a222373'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:40.194130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] The token cache is being invalidate because project 1c3473a621a54a13ba9b934bcb689343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:40.194413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:40.195099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-806ceedc-401e-4642-a439-3e8b0a222373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:40.197388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 969/1933] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:40 2022] DELETE /identity/v3/projects/1c3473a621a54a13ba9b934bcb689343 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:40.204727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.205016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.205289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.225628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:40.226940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:40.317199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 965/1934] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:40.322499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.322815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.323091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.342634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:40.343839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:40.352447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 970/1935] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:40.358248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.368654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73611e3-27a8-41e9-b551-c15d8b7550f7 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.373776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.374709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.375156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.375758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.376696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:40.377224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.379089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.392253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 966/1936] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:40.396682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.405772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f94145-7c00-47d7-a24b-08b171e5358b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.411000 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.411910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.412200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.412477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.413176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.415914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.445846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 971/1937] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:40 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:40.446978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.456552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9614cf-b722-422f-9996-b1273c6360b9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.516976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.517665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.517954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.518237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.519006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.520942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.540867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 967/1938] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:40 2022] POST /identity/v3/users => generated 281 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:40.544915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.554936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d636d27-c51f-424e-a3a6-9e779038580d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.560205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.560862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.561142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.561417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.562126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.563788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.574059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 972/1939] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:40.577792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.587905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803a0aa-9963-408d-8df1-1d4e967df03c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.592505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.593158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.593440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.593714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.594455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.596074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba5cc5-226b-4af3-bfea-a226fdfefb8d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.606079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 968/1940] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:13:40.610012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.620263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a061bef-26e2-480a-abe6-2ffc5f1c570a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.624840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.625715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.625996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.626296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] PATH_INFO: `/v3/projects/bd489bdf297b48c88d9f95013cbad652/users/6e4c3a4cd243419eb16c2fee22bed0fc/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.640489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd489bdf297b48c88d9f95013cbad652, user_id=6e4c3a4cd243419eb16c2fee22bed0fc, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.643163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.657584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 973/1941] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:40 2022] PUT /identity/v3/projects/bd489bdf297b48c88d9f95013cbad652/users/6e4c3a4cd243419eb16c2fee22bed0fc/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:40.669030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.669325 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.669609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.696905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] MFA Rules not processed for user `6e4c3a4cd243419eb16c2fee22bed0fc`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:40.698149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:40.759955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 969/1942] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:40.791885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.793807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:40.851433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55c07e5-9637-46d9-84d8-0abac4c02ecb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.856212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.856869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.857151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.857429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.866441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.868631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e4deb2-864d-41d1-b318-a735244b4313 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:40.877525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 974/1943] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:40.891500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:40.951652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5764154-37d5-41fa-9cd0-c57176826723 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:40.956238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:40.957131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:40.957416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:40.957694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] PATH_INFO: `/v3/users/6e4c3a4cd243419eb16c2fee22bed0fc` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:40.958912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4c3a4cd243419eb16c2fee22bed0fc)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:40.960822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.005655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4c3a4cd243419eb16c2fee22bed0fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.017283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4c3a4cd243419eb16c2fee22bed0fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.018005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4c3a4cd243419eb16c2fee22bed0fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.025770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4c3a4cd243419eb16c2fee22bed0fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.034265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4c3a4cd243419eb16c2fee22bed0fc'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.040887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 970/1944] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:40 2022] DELETE /identity/v3/users/6e4c3a4cd243419eb16c2fee22bed0fc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:41.045367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.045649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.045932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.062661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:41.063927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:41.123877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 975/1945] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:41.134265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.135972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:41.190747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd0784-5770-4738-8575-77c1de0699b8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.194631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.195280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.195568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.195846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.204969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.206654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0241e0-4e71-465a-9d86-96096eb47350 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.216751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 971/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:41.488779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.490180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:41.507790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e019df-2df7-4de1-9f95-866a89e67474 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.514209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.515285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.524850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.525286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] PATH_INFO: `/v3/projects/bd489bdf297b48c88d9f95013cbad652` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.526957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd489bdf297b48c88d9f95013cbad652)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.533219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.579091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd489bdf297b48c88d9f95013cbad652', 'request_id': 'req-14bea56d-0593-4498-b657-b69f4f1fc097'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.584296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd489bdf297b48c88d9f95013cbad652', 'request_id': 'req-14bea56d-0593-4498-b657-b69f4f1fc097'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.591180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd489bdf297b48c88d9f95013cbad652', 'request_id': 'req-14bea56d-0593-4498-b657-b69f4f1fc097'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.602107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] The token cache is being invalidate because project bd489bdf297b48c88d9f95013cbad652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:41.602324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.602976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14bea56d-0593-4498-b657-b69f4f1fc097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:41.604500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 976/1947] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:41 2022] DELETE /identity/v3/projects/bd489bdf297b48c88d9f95013cbad652 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:41.609377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.609821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.609910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.627378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:41.628554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:41.705943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 972/1948] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:41.715141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.715714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.717932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.750023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:41.751305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:41.773039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 977/1949] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:41.777387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.787839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a093da94-c0c0-4f68-87e4-0cdefa70054a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.793493 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.794297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.794599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.794886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.795608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:41.795908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.797508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.810136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 973/1950] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:41.814490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.823983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1260baa-ad77-49b2-a393-c28b0ba96ce1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.828774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.829675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.829957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.830233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.831035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.832916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.857768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 978/1951] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:41 2022] POST /identity/v3/projects => generated 363 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:41.861887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.872108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17735f-aefe-4e48-b2dd-55de44ce6dfa admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.932613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.933298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.933624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.933909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.934620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.936792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.956574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 974/1952] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:41 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:41.960795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:41.971697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f331c-4642-417a-93c5-44d533f37fbd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:41.979441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:41.979441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:41.979441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:41.979441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:41.979802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:41.981196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:41.993321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 979/1953] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:41.997287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:42.007442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9487c-cf3f-4bf1-82ca-3df75dc4514f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:42.012822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:42.013522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:42.013807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:42.014080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:42.014830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:42.016417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94f490-4722-487e-8a34-db3963954560 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:42.026518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 975/1954] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:42.030398 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:42.040604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda993-3ac6-4443-ae5a-2c03b8cab836 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:42.045559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:42.046444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:42.046759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:42.047031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] PATH_INFO: `/v3/projects/d918058ed3cc4de0be0a9bfc96a36e12/users/4e8d5674795342898f7a3ca2c348ec15/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:42.063086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d918058ed3cc4de0be0a9bfc96a36e12, user_id=4e8d5674795342898f7a3ca2c348ec15, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:42.066110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:42.080640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 980/1955] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:42 2022] PUT /identity/v3/projects/d918058ed3cc4de0be0a9bfc96a36e12/users/4e8d5674795342898f7a3ca2c348ec15/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:42.094861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:42.095200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:42.095492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:42.156160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] MFA Rules not processed for user `4e8d5674795342898f7a3ca2c348ec15`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:42.156160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:42.330669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 976/1956] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:42 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:42.356789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:42.361340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:42.441574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8fb42-50a2-48fa-a541-ac0a494670a2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:42.447109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:42.447823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:42.448210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:42.448501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:42.457633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:42.459102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783cfd4-3ecd-4a21-9128-f8e014a04a25 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:42.468722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 981/1957] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:42 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:43.471505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:43.472929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:43.535545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8774734-8e1b-4e47-a5b6-463206bbcc69 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:43.540662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:43.541540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:43.541818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:43.542087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] PATH_INFO: `/v3/users/34e71d5087ff488a83ee584302d673eb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:43.543313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] RBAC: Authorizing `identity:delete_user(user_id=34e71d5087ff488a83ee584302d673eb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:43.545224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:43.589901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34e71d5087ff488a83ee584302d673eb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:43.601406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34e71d5087ff488a83ee584302d673eb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:43.602702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34e71d5087ff488a83ee584302d673eb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:43.609410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34e71d5087ff488a83ee584302d673eb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:43.616109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34e71d5087ff488a83ee584302d673eb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:43.622544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 977/1958] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:43 2022] DELETE /identity/v3/users/34e71d5087ff488a83ee584302d673eb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:43.626968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:43.627442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:43.627533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:43.644753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:43.645972 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:43.705305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 982/1959] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:43.715767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:43.717210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:43.772760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9ff8f-6b96-4064-87fb-a4db7c8d90df admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:43.777372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:43.778139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:43.778420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:43.778733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:43.788484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:43.790770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:43.801416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 978/1960] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:44.179519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:44.181523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:44.202450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541c0c7-c0a0-4328-838d-29d87f3d1e33 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:44.209237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:44.210229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:44.211727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:44.212281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] PATH_INFO: `/v3/projects/778dc663c7d54aa39bfbfd414e023110` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:44.213560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=778dc663c7d54aa39bfbfd414e023110)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:44.215578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:44.268592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '778dc663c7d54aa39bfbfd414e023110', 'request_id': 'req-155644f2-7b72-443e-a8dc-5444e0c7ba6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.274943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '778dc663c7d54aa39bfbfd414e023110', 'request_id': 'req-155644f2-7b72-443e-a8dc-5444e0c7ba6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.285265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '778dc663c7d54aa39bfbfd414e023110', 'request_id': 'req-155644f2-7b72-443e-a8dc-5444e0c7ba6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.296716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] The token cache is being invalidate because project 778dc663c7d54aa39bfbfd414e023110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:44.297007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.297657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.299260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 983/1961] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:44 2022] DELETE /identity/v3/projects/778dc663c7d54aa39bfbfd414e023110 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:44.303672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:44.313839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93525d-3670-4f44-b51a-48faecba12aa service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:44.375007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:44.376066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:44.376709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:44.377231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] PATH_INFO: `/v3/users/2684662015c64ef9b418c0e9bf8fbf8a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:44.378955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2684662015c64ef9b418c0e9bf8fbf8a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:44.381875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:44.451577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2684662015c64ef9b418c0e9bf8fbf8a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.464303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2684662015c64ef9b418c0e9bf8fbf8a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.465011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2684662015c64ef9b418c0e9bf8fbf8a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.471754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2684662015c64ef9b418c0e9bf8fbf8a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.479671 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2684662015c64ef9b418c0e9bf8fbf8a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.485938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 979/1962] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:44 2022] DELETE /identity/v3/users/2684662015c64ef9b418c0e9bf8fbf8a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:13:44.753203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:44.754675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:44.768185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155644f2-7b72-443e-a8dc-5444e0c7ba6d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:44.824636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:44.825506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:44.825788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:44.826063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] PATH_INFO: `/v3/projects/08c92ea416d347abbed5654913aed6d8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:44.827252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c92ea416d347abbed5654913aed6d8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:44.829130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:44.874351 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c92ea416d347abbed5654913aed6d8', 'request_id': 'req-06a421cd-6034-4453-9bb0-83a9d7f8d16a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.879684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c92ea416d347abbed5654913aed6d8', 'request_id': 'req-06a421cd-6034-4453-9bb0-83a9d7f8d16a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.888758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c92ea416d347abbed5654913aed6d8', 'request_id': 'req-06a421cd-6034-4453-9bb0-83a9d7f8d16a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.900989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] The token cache is being invalidate because project 08c92ea416d347abbed5654913aed6d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:44.901282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.901979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:44.903875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 984/1963] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:44 2022] DELETE /identity/v3/projects/08c92ea416d347abbed5654913aed6d8 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:44.907839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:44.909233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:44.922523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aced92e-7232-4164-a58c-f9f71f05731a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:44.981044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:44.981936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:44.982214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:44.982487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] PATH_INFO: `/v3/users/01451e889d894ce9b2aa2badbf45ab89` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:44.983768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01451e889d894ce9b2aa2badbf45ab89)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:44.985727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.034010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01451e889d894ce9b2aa2badbf45ab89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.045961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01451e889d894ce9b2aa2badbf45ab89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.046801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01451e889d894ce9b2aa2badbf45ab89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.053414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01451e889d894ce9b2aa2badbf45ab89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.060365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b9ced61e-2831-4417-9aae-bb208eb8a137 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01451e889d894ce9b2aa2badbf45ab89'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.067680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 980/1964] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:13:44 2022] DELETE /identity/v3/users/01451e889d894ce9b2aa2badbf45ab89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:45.338461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.339918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:45.352335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a421cd-6034-4453-9bb0-83a9d7f8d16a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.409990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.410877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.411162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.411433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] PATH_INFO: `/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.412606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324e1f55cbb44cec9d64e1dba8dd49f2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.414540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.464792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324e1f55cbb44cec9d64e1dba8dd49f2', 'request_id': 'req-bd73029a-5d32-454b-bc5c-45676be27d14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.470367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324e1f55cbb44cec9d64e1dba8dd49f2', 'request_id': 'req-bd73029a-5d32-454b-bc5c-45676be27d14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.478374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324e1f55cbb44cec9d64e1dba8dd49f2', 'request_id': 'req-bd73029a-5d32-454b-bc5c-45676be27d14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.490183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] The token cache is being invalidate because project 324e1f55cbb44cec9d64e1dba8dd49f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:13:45.490475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.491191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bd73029a-5d32-454b-bc5c-45676be27d14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:13:45.493445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 985/1965] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:13:45 2022] DELETE /identity/v3/projects/324e1f55cbb44cec9d64e1dba8dd49f2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:45.499711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.500207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.500296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.519801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:45.520972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:45.581388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 981/1966] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:45.589137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.589428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.589707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.607826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:45.609003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:45.617132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 986/1967] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:45.622083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.631548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5305e-661c-4cfd-bb44-2ffd8e600b3c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.636311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.636966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.637249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.637521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.638238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:13:45.638542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.640195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.651349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 982/1968] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:13:45.655478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.664966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7200d372-875e-405a-99d6-3f6ec8747ab6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.669569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.670208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.670487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.670796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.671480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.673339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.699084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 987/1969] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:13:45 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:45.703291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.713271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157d38b-e0ea-44c4-8d43-ac2118c666cb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.769050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.769729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.770020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.770291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.771025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.772961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.793575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 983/1970] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:13:45 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:13:45.797607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.808848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5029371-2f97-4bb6-bb42-f72b0f6a1f16 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.813515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.814196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.814478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.814789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.815689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.817303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.828633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 988/1971] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:45.832620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.843272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5b8a-4e14-488f-b20b-c97b44896a40 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.847977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.848650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.848933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.849208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.849927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.852489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e451a00-0eed-4836-a77a-8de2ce5d0756 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.864626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 984/1972] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:13:45.870125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:45.880562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09701711-890d-4713-a45f-a4260cee298d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:45.885547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:45.886466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.887132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.887416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] PATH_INFO: `/v3/projects/76d421fe5f96421db7d4eeedd205b462/users/fc7eae5aa3594459bea417a96aae7d8d/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.902822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76d421fe5f96421db7d4eeedd205b462, user_id=fc7eae5aa3594459bea417a96aae7d8d, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:45.905477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:45.920088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 989/1973] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:13:45 2022] PUT /identity/v3/projects/76d421fe5f96421db7d4eeedd205b462/users/fc7eae5aa3594459bea417a96aae7d8d/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:13:45.925055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830c06-535d-47ca-be9f-6482c202c644 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:45.925378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830c06-535d-47ca-be9f-6482c202c644 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:45.925643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05830c06-535d-47ca-be9f-6482c202c644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:45.944560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-05830c06-535d-47ca-be9f-6482c202c644 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:45.946043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-05830c06-535d-47ca-be9f-6482c202c644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:46.006381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 985/1974] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:46.016073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:46.017819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:46.092085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c05f5c-27d6-4676-a0b7-1bf025be6da1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:46.095817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:46.096472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:46.096757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:46.097031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:46.106653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:46.108084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:46.118012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 990/1975] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:46.781825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c378-c960-4b13-bf89-3176157d6155 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:46.782273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c378-c960-4b13-bf89-3176157d6155 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:46.782431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7c378-c960-4b13-bf89-3176157d6155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:46.813681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b2b7c378-c960-4b13-bf89-3176157d6155 None None] MFA Rules not processed for user `fc7eae5aa3594459bea417a96aae7d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:46.814971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b2b7c378-c960-4b13-bf89-3176157d6155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:46.877733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 986/1976] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:13:46.888475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:13:46.889931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:46.947968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce1bd9-a85c-45e2-8f88-e8fccbe7b975 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:13:46.952968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:13:46.953655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:46.953936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:46.954210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:46.963722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:13:46.965138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:13:46.974026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 991/1977] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:13:48.349330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d22ff-8882-4b83-aa78-873c91b745f9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:13:48.349780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d22ff-8882-4b83-aa78-873c91b745f9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:13:48.349892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d22ff-8882-4b83-aa78-873c91b745f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:13:48.369796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-842d22ff-8882-4b83-aa78-873c91b745f9 None None] MFA Rules not processed for user `fc7eae5aa3594459bea417a96aae7d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:13:48.371205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-842d22ff-8882-4b83-aa78-873c91b745f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:13:48.378094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 987/1978] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:13:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:05.543122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:05.544555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:05.560414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf4f7da-a3a8-4047-bfb6-810edc18f7e4 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:05.564916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:05.565788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:05.566064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:05.566558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] PATH_INFO: `/v3/users/191eed708fe2444fa9dd84d0ef9772e4` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:05.568204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191eed708fe2444fa9dd84d0ef9772e4)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:05.570925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:05.620132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191eed708fe2444fa9dd84d0ef9772e4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:05.633203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191eed708fe2444fa9dd84d0ef9772e4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:05.633921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191eed708fe2444fa9dd84d0ef9772e4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:05.634517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191eed708fe2444fa9dd84d0ef9772e4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:05.641191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191eed708fe2444fa9dd84d0ef9772e4'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:05.653771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 992/1979] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:05 2022] DELETE /identity/v3/users/191eed708fe2444fa9dd84d0ef9772e4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:05.658206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:05.658755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:05.658849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:05.676293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:05.677478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:05.737509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 988/1980] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:05.748482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:05.750196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:05.816446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1fe1e-c939-4df2-8e93-56877eebb415 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:05.821736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:05.822559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:05.823079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:05.823618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:05.836637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:05.838195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:05.849562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 993/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:05.962050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:05.963901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:05.977363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32f696-455b-4336-9f35-d92044edc9e3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:05.982138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:05.983284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:05.983569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:05.983842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] PATH_INFO: `/v3/users/c520132de15345be9472b792965323a3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:05.985048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c520132de15345be9472b792965323a3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:05.987020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.053886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c520132de15345be9472b792965323a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.068716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c520132de15345be9472b792965323a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.069814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c520132de15345be9472b792965323a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.081170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c520132de15345be9472b792965323a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.093877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c520132de15345be9472b792965323a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.105617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 989/1982] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:05 2022] DELETE /identity/v3/users/c520132de15345be9472b792965323a3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:06.193689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.195325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.228689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf977cb-112c-4297-847f-3efcc5d6711f service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.317712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.318616 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.319052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.319566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] PATH_INFO: `/v3/projects/0c9be18b8d1d4ac0b589db856d29163a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.320996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c9be18b8d1d4ac0b589db856d29163a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.323110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.372287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.374200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.375130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c9be18b8d1d4ac0b589db856d29163a', 'request_id': 'req-be315be8-5a5f-4d86-93c9-6b329138295c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.381983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c9be18b8d1d4ac0b589db856d29163a', 'request_id': 'req-be315be8-5a5f-4d86-93c9-6b329138295c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.390257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638fccb-b945-414c-9e56-551d7afae3ac admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.391241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c9be18b8d1d4ac0b589db856d29163a', 'request_id': 'req-be315be8-5a5f-4d86-93c9-6b329138295c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.406172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] The token cache is being invalidate because project 0c9be18b8d1d4ac0b589db856d29163a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:06.406437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.407130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.411441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 994/1983] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:06 2022] DELETE /identity/v3/projects/0c9be18b8d1d4ac0b589db856d29163a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:06.412426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.415454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.462638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.463719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.464369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.464369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] PATH_INFO: `/v3/projects/3e1803826fca42f686f47bd2032828b1` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.465555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e1803826fca42f686f47bd2032828b1)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.467522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.484104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be315be8-5a5f-4d86-93c9-6b329138295c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.489330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.490260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.490870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.491152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] PATH_INFO: `/v3/users/f1be9baf38c74461b81fbc14d8a5a26d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.493132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1be9baf38c74461b81fbc14d8a5a26d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.495301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.524857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e1803826fca42f686f47bd2032828b1', 'request_id': 'req-a084934f-599c-4f84-94b6-e2e0c9087b6e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.532063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e1803826fca42f686f47bd2032828b1', 'request_id': 'req-a084934f-599c-4f84-94b6-e2e0c9087b6e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.540736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e1803826fca42f686f47bd2032828b1', 'request_id': 'req-a084934f-599c-4f84-94b6-e2e0c9087b6e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.547481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1be9baf38c74461b81fbc14d8a5a26d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.555277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] The token cache is being invalidate because project 3e1803826fca42f686f47bd2032828b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:06.555586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.556180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a084934f-599c-4f84-94b6-e2e0c9087b6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.561304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 990/1984] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:06 2022] DELETE /identity/v3/projects/3e1803826fca42f686f47bd2032828b1 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:06.562109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1be9baf38c74461b81fbc14d8a5a26d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.562644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.562875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1be9baf38c74461b81fbc14d8a5a26d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.562990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.563212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.563684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1be9baf38c74461b81fbc14d8a5a26d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.573170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a23d606-4de1-4482-aa44-03980c86f648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1be9baf38c74461b81fbc14d8a5a26d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.584740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:06.586319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.590002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 995/1985] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:06 2022] DELETE /identity/v3/users/f1be9baf38c74461b81fbc14d8a5a26d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:06.647060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 991/1986] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:06.655478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.655772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.656054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.675363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:06.676557 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.684696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 996/1987] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:06.688879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.700361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1c394-781a-4146-9f93-34ee33369d31 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.705912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.706622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.706912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.707188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.708056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:06.708385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.710597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.722430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 992/1988] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:06.727439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.737354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581fb1c7-7cfb-4b41-9bbc-127c68e9fe5b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.743017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.743708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.744477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.744750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.745445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.747359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.773157 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 997/1989] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:06 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:06.777612 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.787854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9eba1-becb-43d4-8f6c-f464aa820b3c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.843741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.844352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.844643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.844925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.845645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.847574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.870884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 993/1990] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:06 2022] POST /identity/v3/users => generated 279 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:06.872190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.878712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.880419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:06.885233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9d97c3-075f-43a3-a3f0-d604375987b9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.892803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a262bf-2bb1-46ce-8e03-3ba00e2fa8db admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.896917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.898937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.899130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.899632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.900011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.900299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.900404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.900571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] PATH_INFO: `/v3/projects/0c356b73cdf24621be619e381873bea6` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.901476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.901812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c356b73cdf24621be619e381873bea6)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.903498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.903759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.919897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 998/1991] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:06.920922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.933318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c50d8-ca89-4f86-bef6-b78210143768 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.938368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:06.939123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:06.939486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:06.939827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:06.940622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:06.942755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:06.956943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 999/1992] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:06.958553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:06.963212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c356b73cdf24621be619e381873bea6', 'request_id': 'req-3812290c-fe43-4895-8e10-c0ee39cde36c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.969652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c472252-90ec-4fdf-bfcc-d75b4cce06e3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:06.971049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c356b73cdf24621be619e381873bea6', 'request_id': 'req-3812290c-fe43-4895-8e10-c0ee39cde36c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.981207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c356b73cdf24621be619e381873bea6', 'request_id': 'req-3812290c-fe43-4895-8e10-c0ee39cde36c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.995851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] The token cache is being invalidate because project 0c356b73cdf24621be619e381873bea6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:06.996140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.997231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-3812290c-fe43-4895-8e10-c0ee39cde36c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:06.999375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 994/1993] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:06 2022] DELETE /identity/v3/projects/0c356b73cdf24621be619e381873bea6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:07.004427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f12c-6530-4d8a-b7e8-8983e3600eb1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.004780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f12c-6530-4d8a-b7e8-8983e3600eb1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.005060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5981f12c-6530-4d8a-b7e8-8983e3600eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.024474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5981f12c-6530-4d8a-b7e8-8983e3600eb1 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:07.025674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5981f12c-6530-4d8a-b7e8-8983e3600eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.032005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.032911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.033196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.033471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] PATH_INFO: `/v3/projects/46f32c70dd7b403bafd221b0e374ee03/users/e48bfb9601f64f16be79c06f678fbd46/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.049938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] RBAC: Authorizing `identity:create_grant(project_id=46f32c70dd7b403bafd221b0e374ee03, user_id=e48bfb9601f64f16be79c06f678fbd46, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.052620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75bddb-a145-4b87-8b25-9921d0d1988e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.066971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1000/1994] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:06 2022] PUT /identity/v3/projects/46f32c70dd7b403bafd221b0e374ee03/users/e48bfb9601f64f16be79c06f678fbd46/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:07.078372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.079011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.079294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.093153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 995/1995] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:07.100436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.101299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.101590 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.107829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] MFA Rules not processed for user `e48bfb9601f64f16be79c06f678fbd46`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:07.109047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.119417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:07.120601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.175800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1001/1996] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:07.177373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 996/1997] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:07.181531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.181673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.182881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.192163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99039f76-dbe8-4793-b80e-a85a590de345 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.194844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ccf1fe-5ee5-4c87-b7e2-b1179e3fa527 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.197317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.197975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.198255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.198526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.199278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:07.199573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.199702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.200357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.200642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.201062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.201166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.201755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.204174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.216857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1002/1998] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:07.217832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.228549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f7a8b-ac81-4cf2-a4d9-7391a38d58ac admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.232192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 997/1999] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/projects => generated 355 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:07.235919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.236902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.237569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.237848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.238121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.238841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.240756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.266114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1003/2000] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:07.270227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.299954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d380d62-633f-4aa7-862e-b3428ac5d1c3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.353610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c959fd30-e277-48a2-8f48-47191528c4fb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.370079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.371637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.371795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.371911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.372191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.372407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.372693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.372884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.372982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.373754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.375172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.375714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.397301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 998/2001] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/users => generated 284 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:07.402104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.404733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1004/2002] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:07.407875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.421419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1477d-a4c2-4839-bb5a-de95a8e6af1e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.424640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba68c9-9576-4896-b693-9b7e557a1c58 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.429476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.430556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.430896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.431301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.431927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.432237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.432525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.432805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.433585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.433876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.436509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.437044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.452151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1005/2003] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:14:07.452449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 999/2004] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:14:07.453179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.455422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.468580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5606-eeff-4207-85f6-1993b48bccb5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.468835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e02918b-5f81-402b-8b1c-afdc6170f2de admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.474875 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.475112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.475824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.476132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.476259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.476446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.476665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.477044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] PATH_INFO: `/v3/projects/14433f30b34e4c3889f3ab486bb56965/users/8d56db93a0af4b93859566b5f8861b77/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.477173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.478826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.490644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1006/2005] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:07.494096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14433f30b34e4c3889f3ab486bb56965, user_id=8d56db93a0af4b93859566b5f8861b77, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.494685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.497058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.504732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f42d5c0-e157-416c-922b-562a910e9ee0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.513699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1000/2006] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:07 2022] PUT /identity/v3/projects/14433f30b34e4c3889f3ab486bb56965/users/8d56db93a0af4b93859566b5f8861b77/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:07.517601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.565647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.566542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.566862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.567264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] PATH_INFO: `/v3/projects/6fb2fc2755bb441f9baf034044888cfd/users/c560ff12e70f4224a826aa3075eb8d22/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.582552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fb2fc2755bb441f9baf034044888cfd, user_id=c560ff12e70f4224a826aa3075eb8d22, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.586450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b9b89f-24af-49e4-800c-9aeb5e19c37b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.593009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43846241-24cf-40c0-ba56-f60230900a59 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.599338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.600271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.600271 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.600601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.601690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.612527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1007/2007] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:07 2022] PUT /identity/v3/projects/6fb2fc2755bb441f9baf034044888cfd/users/c560ff12e70f4224a826aa3075eb8d22/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:07.612737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.614123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb887b-c9e6-41e9-a08c-220106ba3b39 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.614431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb887b-c9e6-41e9-a08c-220106ba3b39 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.614867 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb887b-c9e6-41e9-a08c-220106ba3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.620291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1001/2008] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:14:07.621477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.633981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fdcc0-4cf4-4703-9a78-53fa3bda3b67 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.644115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-efcb887b-c9e6-41e9-a08c-220106ba3b39 None None] MFA Rules not processed for user `c560ff12e70f4224a826aa3075eb8d22`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:07.645333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-efcb887b-c9e6-41e9-a08c-220106ba3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.695328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.697018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.697306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.697589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] PATH_INFO: `/v3/projects/14433f30b34e4c3889f3ab486bb56965/users/8d56db93a0af4b93859566b5f8861b77/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.699733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14433f30b34e4c3889f3ab486bb56965, user_id=8d56db93a0af4b93859566b5f8861b77, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.702623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.715541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1002/2009] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:07 2022] PUT /identity/v3/projects/14433f30b34e4c3889f3ab486bb56965/users/8d56db93a0af4b93859566b5f8861b77/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:07.717429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1008/2010] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:07.722106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.725144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.725586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.726090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.756382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] MFA Rules not processed for user `8d56db93a0af4b93859566b5f8861b77`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:07.757904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.811834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df6fc9-9dd1-43a5-959a-7d2916fa6586 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.817848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.818641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.819191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.819517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.820874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.823403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.832104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1009/2011] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:07.847340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.847340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:07.858094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1003/2012] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:07.861966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.925328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00107b6f-4d20-400f-9623-c480988dae42 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.945190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cc27d9-dd4e-48f4-be87-250423e83905 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:07.951065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.951909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.952239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.952791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:07.953436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:07.955765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:07.987738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1004/2013] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:07 2022] POST /identity/v3/users => generated 299 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:07.989210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:07.990841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:07.992958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:07.992958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:07.992958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.000815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ada16ce-bc6e-4bf9-b6bc-9622cce0bccd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.007118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.007841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.008784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.009175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.010518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.012706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.028267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1005/2014] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:08.032567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.045360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db0b3e-27e4-4c35-b480-86054f9d265b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.065421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.066665 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.067029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.067374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] PATH_INFO: `/v3/projects/fb42024e284b4711a8bee464ec86cd9f/users/749de73347234890a7cc4ac7c18c7814/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.073006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.075206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.088192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1010/2015] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:07 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:08.092017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb42024e284b4711a8bee464ec86cd9f, user_id=749de73347234890a7cc4ac7c18c7814, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.094800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.114409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1006/2016] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:08 2022] PUT /identity/v3/projects/fb42024e284b4711a8bee464ec86cd9f/users/749de73347234890a7cc4ac7c18c7814/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:08.119642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.133668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e4e9a-72ed-413c-8a4d-9cd859855f44 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.203540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.248186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.249044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.249432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.249857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.250718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.253034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.263790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1011/2017] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:08 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:08.268166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.277520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04bc207-7cd6-4007-92c4-e6827ea6f503 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.283355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.284384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.284668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.284951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] PATH_INFO: `/v3/projects/fb42024e284b4711a8bee464ec86cd9f/users/749de73347234890a7cc4ac7c18c7814/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.287648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb42024e284b4711a8bee464ec86cd9f, user_id=749de73347234890a7cc4ac7c18c7814, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.290608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5257ae9e-a22b-4f18-94ce-c208ad8370ca admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.305508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1012/2018] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:08 2022] PUT /identity/v3/projects/fb42024e284b4711a8bee464ec86cd9f/users/749de73347234890a7cc4ac7c18c7814/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:08.315519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.315807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.316083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.328689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f05fbea-49ce-4ece-9b1c-5bcc850e1424 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.356980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] MFA Rules not processed for user `749de73347234890a7cc4ac7c18c7814`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:08.358294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:08.389689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.390669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.391108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.391553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.447713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1013/2019] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:08.453733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.454649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.458936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.460816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:08.464936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1007/2020] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:08.472420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a50bd-7231-4bd2-973f-0a4c362fbd8e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.477041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.477703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.477990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.478266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.495181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.497370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023987f-45f6-40da-8db9-04516bab895d service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.510366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1014/2021] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:08.551154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.630151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b94d84-a3c9-4fcc-bb92-d130b714005a service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.635313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.636195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.636477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.636753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] PATH_INFO: `/v3/users/c560ff12e70f4224a826aa3075eb8d22` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.638054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c560ff12e70f4224a826aa3075eb8d22)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.640028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.696718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c560ff12e70f4224a826aa3075eb8d22'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:08.707799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c560ff12e70f4224a826aa3075eb8d22'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:08.708403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c560ff12e70f4224a826aa3075eb8d22'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:08.715205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c560ff12e70f4224a826aa3075eb8d22'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:08.723158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c560ff12e70f4224a826aa3075eb8d22'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:08.729207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1008/2022] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:08 2022] DELETE /identity/v3/users/c560ff12e70f4224a826aa3075eb8d22 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:08.733812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e651-c115-4759-9087-5292a472730b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.734343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e651-c115-4759-9087-5292a472730b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.734343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1e651-c115-4759-9087-5292a472730b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.752420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-dcc1e651-c115-4759-9087-5292a472730b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:08.753586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dcc1e651-c115-4759-9087-5292a472730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:08.810396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1015/2023] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:08.821020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:08.822421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:08.882667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1220fb-fd48-40f8-b15c-4ed22fa6c83c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:08.886880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:08.887865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:08.888342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:08.888888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:08.900326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:08.901850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:08.914797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1009/2024] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:09.179814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e651-c115-4759-9087-5292a472730b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:09.181367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-dcc1e651-c115-4759-9087-5292a472730b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:09.196468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1e651-c115-4759-9087-5292a472730b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:09.201240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:09.202118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:09.202399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:09.202774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] PATH_INFO: `/v3/projects/6fb2fc2755bb441f9baf034044888cfd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:09.203946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fb2fc2755bb441f9baf034044888cfd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:09.206177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:09.254385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fb2fc2755bb441f9baf034044888cfd', 'request_id': 'req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.259799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fb2fc2755bb441f9baf034044888cfd', 'request_id': 'req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.266769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fb2fc2755bb441f9baf034044888cfd', 'request_id': 'req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.277866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] The token cache is being invalidate because project 6fb2fc2755bb441f9baf034044888cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:09.278196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.278785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.280322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1016/2025] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:09 2022] DELETE /identity/v3/projects/6fb2fc2755bb441f9baf034044888cfd => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:09.284304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:09.295439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05600fa8-a6a3-4a80-9f39-735718acfb15 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:09.350069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:09.351741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:09.352124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:09.352403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] PATH_INFO: `/v3/users/749de73347234890a7cc4ac7c18c7814` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:09.353605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] RBAC: Authorizing `identity:delete_user(user_id=749de73347234890a7cc4ac7c18c7814)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:09.355566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:09.404680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749de73347234890a7cc4ac7c18c7814'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.416834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749de73347234890a7cc4ac7c18c7814'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.417535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749de73347234890a7cc4ac7c18c7814'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.424112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749de73347234890a7cc4ac7c18c7814'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.431767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-133eb92b-e2e5-41d8-b00f-5086c546c23e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749de73347234890a7cc4ac7c18c7814'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.438017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1010/2026] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:09 2022] DELETE /identity/v3/users/749de73347234890a7cc4ac7c18c7814 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:09.724594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:09.726451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:09.741385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bedba8-9658-4ca2-a070-a93b3a1aa0e0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:09.830420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:09.831437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:09.831721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:09.831995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] PATH_INFO: `/v3/projects/fb42024e284b4711a8bee464ec86cd9f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:09.833216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb42024e284b4711a8bee464ec86cd9f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:09.835976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:09.881320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb42024e284b4711a8bee464ec86cd9f', 'request_id': 'req-3aae009a-0102-4750-b5e9-f172979cb432'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.887407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb42024e284b4711a8bee464ec86cd9f', 'request_id': 'req-3aae009a-0102-4750-b5e9-f172979cb432'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.896219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb42024e284b4711a8bee464ec86cd9f', 'request_id': 'req-3aae009a-0102-4750-b5e9-f172979cb432'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.909332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] The token cache is being invalidate because project fb42024e284b4711a8bee464ec86cd9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:09.909619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.910277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3aae009a-0102-4750-b5e9-f172979cb432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:09.915112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1017/2027] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:09 2022] DELETE /identity/v3/projects/fb42024e284b4711a8bee464ec86cd9f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:09.917330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:09.917826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:09.917916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:09.941391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:09.942902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:10.006939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1011/2028] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:10.016250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.016542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.016823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.035860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:10.037073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:10.045360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1018/2029] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:10.049633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.059736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36a19f-c654-4218-a9e4-d2719213f39c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.064256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.064913 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.065200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.065528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.066309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:10.066640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.068700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.081004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1012/2030] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:10.085480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.095135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc1ea9b-62f4-4ed9-9919-f5cc9d17d70d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.099950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.100731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.101012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.101457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.102286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.104454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.129918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1019/2031] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:10.134786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.144821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309bc65-48e8-41e0-a4d3-7e2fe9d8f858 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.202033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.202732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.203015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.203287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.204167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.206559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.227744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1013/2032] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:10.232267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.243369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20ef47-77dc-430e-81ac-19e1dd8962fb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.248021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.248680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.248966 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.249244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.249961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.251589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.262418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1020/2033] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:10.266125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.276077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8565f-512e-4a33-b22f-2fd119a10fa5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.281358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.282311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.282626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.282910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.283646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.285372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1d47d7-5e24-4ba8-b0eb-fbf535849e1e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.296256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1014/2034] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:10.300387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.310840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58a2573-b9ad-432b-a7ee-8f2e97bc7231 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.315610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.316484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.316759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.317028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] PATH_INFO: `/v3/projects/52e373b77a96461fa1847585a0076ddf/users/3866f0b1bb934e2dab7a92f5793eb28b/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.332952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=52e373b77a96461fa1847585a0076ddf, user_id=3866f0b1bb934e2dab7a92f5793eb28b, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.335661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.347610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1021/2035] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:10 2022] PUT /identity/v3/projects/52e373b77a96461fa1847585a0076ddf/users/3866f0b1bb934e2dab7a92f5793eb28b/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:10.362147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.362438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.362890 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.398733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] MFA Rules not processed for user `3866f0b1bb934e2dab7a92f5793eb28b`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:10.399993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:10.462874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1015/2036] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:10.467604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.547523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3de3263-27e4-41b4-803a-5454eb44137f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.552277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.552944 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.553222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.553494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.554898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.556764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.585601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1022/2037] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:10.587117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.598365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc8cdc-db05-48d8-9ae3-af7b10ae3047 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.662022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.662731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.663039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.663625 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.664011 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.665958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.687198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1016/2038] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/users => generated 298 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:10.691336 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.706051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5225062-b8ce-477f-8580-2734ade69762 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.711756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.712435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.712724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.713001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.713795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.715358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.729836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1023/2039] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:10.731050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.741762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123f4482-9608-4999-8d70-f055011dc0e0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.747123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.748016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.748303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.748579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] PATH_INFO: `/v3/projects/6e76327a80fd4f978646cf21347514d3/users/adaacebfbb1343e6ac49e5db1c27509d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.764762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e76327a80fd4f978646cf21347514d3, user_id=adaacebfbb1343e6ac49e5db1c27509d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.779377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.794161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1017/2040] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:10 2022] PUT /identity/v3/projects/6e76327a80fd4f978646cf21347514d3/users/adaacebfbb1343e6ac49e5db1c27509d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:10.798133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.812232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2d26b-716e-4d49-b52c-6f45d9adcaf7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.877259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.878124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.878690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.879122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.879990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.883198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5949f0ba-2434-411a-95e7-a00db7fcf1cc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.898199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1024/2041] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:10.902685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:10.914708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc2198-7270-4588-b889-852d4a9d180a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:10.929684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:10.931081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.931473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.931850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] PATH_INFO: `/v3/projects/6e76327a80fd4f978646cf21347514d3/users/adaacebfbb1343e6ac49e5db1c27509d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:10.934012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e76327a80fd4f978646cf21347514d3, user_id=adaacebfbb1343e6ac49e5db1c27509d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:10.937069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:10.950876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1018/2042] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:10 2022] PUT /identity/v3/projects/6e76327a80fd4f978646cf21347514d3/users/adaacebfbb1343e6ac49e5db1c27509d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:10.961708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:10.961999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:10.962285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:11.006051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] MFA Rules not processed for user `adaacebfbb1343e6ac49e5db1c27509d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:11.010453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:11.115047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1025/2043] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:11.173609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:11.176194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:11.263566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dedb91-6f45-464b-b5ab-67a79bcb598b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:11.268056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:11.268712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:11.269012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:11.269288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:11.280439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:11.282262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:11.295177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1019/2044] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:11.386870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:11.395983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26547f96-83ac-4dc2-81c4-c2636628a697 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:11.399583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:11.400221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:11.400502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:11.400775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:11.456140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:11.457550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f33bd4-c34e-4f23-826b-aaa83644333a service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:11.467300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1026/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:11.726689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:11.794702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f169afef-c0bc-4d60-9f4a-1e34886fc324 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:11.800251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:11.801148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:11.801425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:11.801710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] PATH_INFO: `/v3/users/3866f0b1bb934e2dab7a92f5793eb28b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:11.802920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3866f0b1bb934e2dab7a92f5793eb28b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:11.805007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:11.852277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3866f0b1bb934e2dab7a92f5793eb28b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:11.863326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3866f0b1bb934e2dab7a92f5793eb28b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:11.863993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3866f0b1bb934e2dab7a92f5793eb28b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:11.870481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3866f0b1bb934e2dab7a92f5793eb28b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:11.877924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3866f0b1bb934e2dab7a92f5793eb28b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:11.885232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1020/2046] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:11 2022] DELETE /identity/v3/users/3866f0b1bb934e2dab7a92f5793eb28b => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:11.889829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:11.890296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:11.890388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:11.907453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:11.908619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:11.967535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1027/2047] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:11.977255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:11.978706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:12.036159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bd1fc-ee10-4092-b271-b66114869468 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:12.040409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:12.041094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:12.041380 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:12.041656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:12.051498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:12.052957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:12.062460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1021/2048] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:12.402561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:12.404576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:12.419889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e11a0b-9eef-4fb6-b154-bc838c4f4d36 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:12.425595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:12.426596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:12.426982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:12.427352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] PATH_INFO: `/v3/projects/52e373b77a96461fa1847585a0076ddf` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:12.429412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52e373b77a96461fa1847585a0076ddf)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:12.431373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:12.485610 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52e373b77a96461fa1847585a0076ddf', 'request_id': 'req-0e2f530a-1b45-4ef0-8bf6-61ca81269077'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.491626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52e373b77a96461fa1847585a0076ddf', 'request_id': 'req-0e2f530a-1b45-4ef0-8bf6-61ca81269077'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.509216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52e373b77a96461fa1847585a0076ddf', 'request_id': 'req-0e2f530a-1b45-4ef0-8bf6-61ca81269077'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.520962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] The token cache is being invalidate because project 52e373b77a96461fa1847585a0076ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:12.521346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.521978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.523567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1028/2049] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:12 2022] DELETE /identity/v3/projects/52e373b77a96461fa1847585a0076ddf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:12.527465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:12.537233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd681-4e18-431b-8e82-65d1c1bfb437 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:12.597132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:12.598012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:12.598349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:12.598656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] PATH_INFO: `/v3/users/adaacebfbb1343e6ac49e5db1c27509d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:12.599874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adaacebfbb1343e6ac49e5db1c27509d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:12.602554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:12.650158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adaacebfbb1343e6ac49e5db1c27509d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.667147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adaacebfbb1343e6ac49e5db1c27509d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.668089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adaacebfbb1343e6ac49e5db1c27509d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.676948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adaacebfbb1343e6ac49e5db1c27509d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.685572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cbc801ca-4e38-4d3d-a02a-07148e9a4c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adaacebfbb1343e6ac49e5db1c27509d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:12.693259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1022/2050] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:12 2022] DELETE /identity/v3/users/adaacebfbb1343e6ac49e5db1c27509d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:12.984005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:12.985504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:12.999910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f530a-1b45-4ef0-8bf6-61ca81269077 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.057750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.058654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.058940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.059216 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] PATH_INFO: `/v3/projects/6e76327a80fd4f978646cf21347514d3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.060478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e76327a80fd4f978646cf21347514d3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.062381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.109986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e76327a80fd4f978646cf21347514d3', 'request_id': 'req-3998da7f-42a1-405c-a342-d0c1445b02da'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:13.115623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e76327a80fd4f978646cf21347514d3', 'request_id': 'req-3998da7f-42a1-405c-a342-d0c1445b02da'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:13.124285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e76327a80fd4f978646cf21347514d3', 'request_id': 'req-3998da7f-42a1-405c-a342-d0c1445b02da'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:13.142295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] The token cache is being invalidate because project 6e76327a80fd4f978646cf21347514d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:13.142640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:13.143309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3998da7f-42a1-405c-a342-d0c1445b02da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:13.144862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1029/2051] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:12 2022] DELETE /identity/v3/projects/6e76327a80fd4f978646cf21347514d3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:13.150724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.151357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.151357 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.170499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:13.171735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:13.232903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1023/2052] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:13.241353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.241635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.241916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.259799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:13.261005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:13.268968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1030/2053] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:13.275000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.284598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5cf9e7-79a5-46a2-9633-214ac9a0ce7d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.289926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.290626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.290918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.291192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.291914 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:13.292298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.293843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.305709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1024/2054] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:13.310006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.320632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a29bae-6fdb-4a24-9dcd-e2b58d6185b0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.325996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.326696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.327212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.327491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.328325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.330541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.371553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1031/2055] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:13 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:13.373050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.383331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee4d22-4084-4407-b2e0-2348badbed7e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.439014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.439703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.439988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.440329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.440956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.443167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.471594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1025/2056] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:13 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:13.473176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.483499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c267-1409-4ca3-88c3-2bb0da63da25 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.488325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.488852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.489242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.489528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.490248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.496208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.505753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1032/2057] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:13.510341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.520249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b49352-db3b-4c96-a715-8339ddf49cb6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.524944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.525597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.525879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.526179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.526956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.528577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46017ad-95c5-461d-b80d-436b6c87f0f7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.538848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1026/2058] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:13.542935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.552694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b273e1-967d-49ac-a8f7-853d73cec602 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.558236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.559183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.559463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.559734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] PATH_INFO: `/v3/projects/361145472124472da21819607fd4d79f/users/a8a3882ead574edfa971c8da0b0bb0ee/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.574187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=361145472124472da21819607fd4d79f, user_id=a8a3882ead574edfa971c8da0b0bb0ee, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.576878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.591617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1033/2059] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:13 2022] PUT /identity/v3/projects/361145472124472da21819607fd4d79f/users/a8a3882ead574edfa971c8da0b0bb0ee/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:13.598446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2ffbd-22e0-401b-8323-94398a2c128a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.598910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2ffbd-22e0-401b-8323-94398a2c128a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.599196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e2ffbd-22e0-401b-8323-94398a2c128a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.618463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-78e2ffbd-22e0-401b-8323-94398a2c128a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:13.621416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-78e2ffbd-22e0-401b-8323-94398a2c128a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:13.679830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1027/2060] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:13.689414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:13.691167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:13.748898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3471ac-aa0d-42a6-9c53-815f57d2fabf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:13.752553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:13.753235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:13.753523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:13.753795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:13.763215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:13.764633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:13.774287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1034/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:14.406336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.407498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.407970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.439344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] MFA Rules not processed for user `a8a3882ead574edfa971c8da0b0bb0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:14.440655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:14.515449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1028/2062] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:14 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:14.521724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.536699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b0b-4e0a-480f-ba8f-bdb8d4c1b05c service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.542636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.543354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.543638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.544459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.544589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.546469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.578491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1035/2063] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:14 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:14.582323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.594421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecac49d-f11b-406f-992b-adfe39d6eb99 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.659777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.660463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.660742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.661012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.661707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.663848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.691473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1029/2064] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:14 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:14.693098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.704372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f03ee8-0019-431a-b597-6b5a0885cb0d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.709100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.709819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.710101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.710379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.711145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.712758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.727003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1036/2065] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:14.728484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.738595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa63c7a-a813-4c0b-854e-646c190dbe25 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.744672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.745899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.746516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.746840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] PATH_INFO: `/v3/projects/60c4682244ce41f686b37b92d7decb43/users/d3854d6a340949b3ac7cd5b29f0a98b6/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.768737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c4682244ce41f686b37b92d7decb43, user_id=d3854d6a340949b3ac7cd5b29f0a98b6, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.769803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.784122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1030/2066] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:14 2022] PUT /identity/v3/projects/60c4682244ce41f686b37b92d7decb43/users/d3854d6a340949b3ac7cd5b29f0a98b6/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:14.787954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.797463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a68641-1b67-475a-91a0-1471352d70a7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.854179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.854984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.855437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.855712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.856441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.858016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a80c8b-500e-488c-848f-85b5ef60bae2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.871657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1037/2067] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:14 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:14.878109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:14.888768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eafe7-bb18-4979-8a95-2f57cefed359 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:14.893747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:14.894675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:14.894961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:14.895232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] PATH_INFO: `/v3/projects/60c4682244ce41f686b37b92d7decb43/users/d3854d6a340949b3ac7cd5b29f0a98b6/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:14.897174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] RBAC: Authorizing `identity:create_grant(project_id=60c4682244ce41f686b37b92d7decb43, user_id=d3854d6a340949b3ac7cd5b29f0a98b6, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:14.900328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:14.910809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1031/2068] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:14 2022] PUT /identity/v3/projects/60c4682244ce41f686b37b92d7decb43/users/d3854d6a340949b3ac7cd5b29f0a98b6/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:15.596499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:15.597011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:15.597104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:15.624819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] MFA Rules not processed for user `d3854d6a340949b3ac7cd5b29f0a98b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:15.626038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:15.699011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1038/2069] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:15 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:15.710252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:15.712286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:15.770990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b3cd35-dba1-429e-a222-61807fcf567b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:15.775092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:15.775743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:15.776025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:15.776302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:15.832376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:15.833833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:15.843261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1032/2070] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:17.206260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:17.216642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852486e-994e-441d-bab3-1520a02d58ee None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:17.220890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:17.222271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:17.222271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:17.222593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:17.234367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:17.236067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e2808-3de3-4747-bc6e-d33c41583bd1 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:17.247344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1039/2071] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:23.498824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:23.500250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:23.563787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914367a-697d-44d6-a5e9-1e51bfc38959 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:23.578006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:23.579060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:23.579412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:23.579688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] PATH_INFO: `/v3/users/e48bfb9601f64f16be79c06f678fbd46` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:23.581229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e48bfb9601f64f16be79c06f678fbd46)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:23.583381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:23.630054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e48bfb9601f64f16be79c06f678fbd46'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:23.642173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e48bfb9601f64f16be79c06f678fbd46'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:23.643100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e48bfb9601f64f16be79c06f678fbd46'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:23.652162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e48bfb9601f64f16be79c06f678fbd46'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:23.659256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e48bfb9601f64f16be79c06f678fbd46'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:23.665865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1033/2072] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:23 2022] DELETE /identity/v3/users/e48bfb9601f64f16be79c06f678fbd46 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:23.670365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:23.670954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:23.670954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:23.688379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:23.689785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:23.760587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1040/2073] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:23.771101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:23.772880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:23.839689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ece0fc-23ec-4a49-a89c-28bb1ec8e119 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:23.844564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:23.845308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:23.845657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:23.846001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:23.856587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:23.861400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:23.874686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1034/2074] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:24.144145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:24.145575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:24.158021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd731b4a-87e0-412e-9ca9-677b854fc693 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:24.163318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:24.164308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.165111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.165454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] PATH_INFO: `/v3/projects/46f32c70dd7b403bafd221b0e374ee03` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.166748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46f32c70dd7b403bafd221b0e374ee03)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:24.169026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:24.218315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46f32c70dd7b403bafd221b0e374ee03', 'request_id': 'req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.224670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46f32c70dd7b403bafd221b0e374ee03', 'request_id': 'req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.236642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46f32c70dd7b403bafd221b0e374ee03', 'request_id': 'req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.249637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] The token cache is being invalidate because project 46f32c70dd7b403bafd221b0e374ee03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:24.249927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.250637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.252490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1041/2075] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:24 2022] DELETE /identity/v3/projects/46f32c70dd7b403bafd221b0e374ee03 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:24.256550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:24.266666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6322622e-ed70-4ed5-b576-593448413050 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:24.324537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:24.325435 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.325714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.325982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] PATH_INFO: `/v3/users/8d56db93a0af4b93859566b5f8861b77` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.327208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d56db93a0af4b93859566b5f8861b77)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:24.329128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:24.375087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d56db93a0af4b93859566b5f8861b77'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.386027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d56db93a0af4b93859566b5f8861b77'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.386737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d56db93a0af4b93859566b5f8861b77'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.393145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d56db93a0af4b93859566b5f8861b77'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.400395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5b74a56b-71f9-4e82-898b-785a162f02b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d56db93a0af4b93859566b5f8861b77'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.407259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1035/2076] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:24 2022] DELETE /identity/v3/users/8d56db93a0af4b93859566b5f8861b77 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:24.680618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:24.682158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:24.696655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb0acb-0e15-45f7-ac2a-8df4ccc3d3a9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:24.755464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:24.756325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.756603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.756875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] PATH_INFO: `/v3/projects/14433f30b34e4c3889f3ab486bb56965` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.758037 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14433f30b34e4c3889f3ab486bb56965)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:24.759945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:24.805635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14433f30b34e4c3889f3ab486bb56965', 'request_id': 'req-455899c0-1476-4dfe-b08f-81b7f7ef8771'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.810995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14433f30b34e4c3889f3ab486bb56965', 'request_id': 'req-455899c0-1476-4dfe-b08f-81b7f7ef8771'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.818353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14433f30b34e4c3889f3ab486bb56965', 'request_id': 'req-455899c0-1476-4dfe-b08f-81b7f7ef8771'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.833074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] The token cache is being invalidate because project 14433f30b34e4c3889f3ab486bb56965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:24.833763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.834020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-455899c0-1476-4dfe-b08f-81b7f7ef8771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:24.835798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1042/2077] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:24 2022] DELETE /identity/v3/projects/14433f30b34e4c3889f3ab486bb56965 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:24.842617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.843169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.844016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.863408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:24.864934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:24.926815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1036/2078] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:24.934828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.935122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.935506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.957617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:24.958861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:24.974975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1043/2079] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:24.979533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:24.988906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919435b4-0778-4317-b9b5-64b239e50037 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:24.993841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:24.994490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:24.994802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:24.995078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:24.995795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:24.996101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:24.997685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.009730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1037/2080] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:25.015021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.024664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2855d544-f123-4d1a-9388-135a36a24c17 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.029287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.029934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.030211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.030509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.031226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.033316 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.059716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1044/2081] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:25.064291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.077957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f49d6-36e7-47e9-9b3f-40d5716b3b41 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.136111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.136770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.137061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.137338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.138040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.140059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.159211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1038/2082] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:25.163258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.174734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffc14f-e66a-4ddc-8e19-def1de9bd27f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.179692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.180372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.180650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.180921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.181670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.183298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.193911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1045/2083] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:25.198348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.208069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d9fa58-297c-4710-94ba-b3d1f65dd080 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.213434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.214089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.214375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.214683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.215412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.217007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3220c9a0-fc9f-450a-a0c1-f467041777bb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.226830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1039/2084] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:25.230910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.240563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc161ee6-704d-4bab-847d-851fdf5ecd8a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.245228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.246324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.246635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.246910 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] PATH_INFO: `/v3/projects/907851e3bce9463988312ba885c73db2/users/fafa36c157d143968e23dfb3985ed776/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.261797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=907851e3bce9463988312ba885c73db2, user_id=fafa36c157d143968e23dfb3985ed776, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.265115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.278318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1046/2085] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:25 2022] PUT /identity/v3/projects/907851e3bce9463988312ba885c73db2/users/fafa36c157d143968e23dfb3985ed776/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:25.298111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.298407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.298717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.327840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] MFA Rules not processed for user `fafa36c157d143968e23dfb3985ed776`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:25.329444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:25.400466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1040/2086] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:25.405023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.468001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c51ba5-f254-4f43-a8e7-525ae58d9d97 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.473209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.473849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.474130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.474399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.475130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.477103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.507521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1047/2087] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:25.509373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.519915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e11c6-4ed5-4150-999f-80f69d020708 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.573857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.574546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.574880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.575154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.575832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.577770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.597956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1041/2088] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/users => generated 296 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:25.602063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.612502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92decc92-c3bc-45a5-89eb-57cac9e55588 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.617302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.618495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.618812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.619085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.619814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.621465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.632580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1048/2089] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:25.638006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.648049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf8a5d7-3adc-4fd4-b435-c36a80a6208f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.652841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.653720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.654000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.654300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] PATH_INFO: `/v3/projects/1b6e842d8648449a9bf1e7937d553f54/users/ba32510fab6247c28fe536a0bea2413b/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.669277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e842d8648449a9bf1e7937d553f54, user_id=ba32510fab6247c28fe536a0bea2413b, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.672030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.684842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1042/2090] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:25 2022] PUT /identity/v3/projects/1b6e842d8648449a9bf1e7937d553f54/users/ba32510fab6247c28fe536a0bea2413b/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:25.688825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.699934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f00980-5594-4eb7-9105-c7a6ddf2e7b6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.759843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.760513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.760797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.761070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.761783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.763415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecf865a-be4b-412e-9b8b-d169bd46e716 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.773075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1049/2091] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:25.778282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.788935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a469d4e-4716-4c96-ab62-1ea3495ba053 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:25.793770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:25.794701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.794987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.795261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] PATH_INFO: `/v3/projects/1b6e842d8648449a9bf1e7937d553f54/users/ba32510fab6247c28fe536a0bea2413b/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.797243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b6e842d8648449a9bf1e7937d553f54, user_id=ba32510fab6247c28fe536a0bea2413b, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:25.799959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:25.810057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1043/2092] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:25 2022] PUT /identity/v3/projects/1b6e842d8648449a9bf1e7937d553f54/users/ba32510fab6247c28fe536a0bea2413b/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:25.820231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:25.820568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:25.821341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:25.847401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] MFA Rules not processed for user `ba32510fab6247c28fe536a0bea2413b`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:25.848620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:25.916523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1050/2093] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:25.932455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:25.934278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:25.997218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf17cf-69be-4947-b504-3d006341691b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:26.000876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:26.001519 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:26.001825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:26.002096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:26.012613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:26.014089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30953ce1-da20-4d5b-ab6e-92bbc9c88145 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:26.024894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1044/2094] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:26.434705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:26.501638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e793ec6-a606-453c-8deb-1b9f24489345 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:26.506313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:26.507210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:26.507492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:26.507764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] PATH_INFO: `/v3/users/fafa36c157d143968e23dfb3985ed776` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:26.509832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fafa36c157d143968e23dfb3985ed776)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:26.512464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:26.563130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fafa36c157d143968e23dfb3985ed776'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:26.578711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fafa36c157d143968e23dfb3985ed776'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:26.579414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fafa36c157d143968e23dfb3985ed776'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:26.580022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fafa36c157d143968e23dfb3985ed776'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:26.588533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fafa36c157d143968e23dfb3985ed776'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:26.600827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1051/2095] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:26 2022] DELETE /identity/v3/users/fafa36c157d143968e23dfb3985ed776 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:26.605558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:26.605848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:26.606124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:26.622736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:26.623936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:26.682109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1045/2096] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:26.691709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:26.693347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:26.750497 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eb8323-5846-4841-82d2-b74348d9cd1b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:26.754179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:26.754856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:26.755142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:26.755422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:26.765461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:26.766947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:26.776729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1052/2097] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:27.041418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:27.046166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:27.060374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0ef59d-95ed-4551-9a02-9adfdaab408f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:27.065252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:27.066425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.066782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.067132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] PATH_INFO: `/v3/projects/907851e3bce9463988312ba885c73db2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.069565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=907851e3bce9463988312ba885c73db2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:27.072994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:27.118124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '907851e3bce9463988312ba885c73db2', 'request_id': 'req-7a3c268f-be94-4c64-ba3b-2c0486e89fea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.123411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '907851e3bce9463988312ba885c73db2', 'request_id': 'req-7a3c268f-be94-4c64-ba3b-2c0486e89fea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.131132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '907851e3bce9463988312ba885c73db2', 'request_id': 'req-7a3c268f-be94-4c64-ba3b-2c0486e89fea'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.142358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] The token cache is being invalidate because project 907851e3bce9463988312ba885c73db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:27.142673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.143288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.144801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1046/2098] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:27 2022] DELETE /identity/v3/projects/907851e3bce9463988312ba885c73db2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:27.148724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:27.157987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19a76e9-0291-439f-acd9-11d1dbe2dcea service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:27.217302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:27.218232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.218544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.218873 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] PATH_INFO: `/v3/users/ba32510fab6247c28fe536a0bea2413b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.220152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba32510fab6247c28fe536a0bea2413b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:27.222065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:27.268394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba32510fab6247c28fe536a0bea2413b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.279484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba32510fab6247c28fe536a0bea2413b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.280131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba32510fab6247c28fe536a0bea2413b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.280720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba32510fab6247c28fe536a0bea2413b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.287664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-240a6774-b699-45a7-95e1-51e703373ad8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba32510fab6247c28fe536a0bea2413b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.300909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1053/2099] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:27 2022] DELETE /identity/v3/users/ba32510fab6247c28fe536a0bea2413b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:27.572585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:27.574539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:27.593096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c268f-be94-4c64-ba3b-2c0486e89fea admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:27.654196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:27.655140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.655408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.655685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] PATH_INFO: `/v3/projects/1b6e842d8648449a9bf1e7937d553f54` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.656927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b6e842d8648449a9bf1e7937d553f54)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:27.658989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:27.717879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b6e842d8648449a9bf1e7937d553f54', 'request_id': 'req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.723337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b6e842d8648449a9bf1e7937d553f54', 'request_id': 'req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.732925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b6e842d8648449a9bf1e7937d553f54', 'request_id': 'req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.745083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] The token cache is being invalidate because project 1b6e842d8648449a9bf1e7937d553f54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:27.745469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.747532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-20cbfb7a-2da0-4c85-a5c8-d1c19d7aa23e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:27.747874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1047/2100] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:27 2022] DELETE /identity/v3/projects/1b6e842d8648449a9bf1e7937d553f54 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:27.754305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.754844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.754951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.778973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:27.780362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:27.862268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1054/2101] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:27.872147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.872447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.872998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.895646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:27.895904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:27.905507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1048/2102] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:27.909579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:27.920238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2003f0a-da8a-4461-8190-34dacfbd08ac None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:27.935336 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:27.936200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.936846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.936846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.941259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:27.941259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:27.941259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:27.960227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1055/2103] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:27.967441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:27.978757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e2234-620f-4088-8158-603bb8c39d00 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:27.987123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:27.987794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:27.990315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:27.990668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:27.991525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:27.993857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.034833 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1049/2104] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:27 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:28.036335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:28.046224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce67f-5ca0-4441-8cec-a3af75df63a4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:28.107278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:28.108021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.108300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.108573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.109275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:28.111200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.130407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1056/2105] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:28 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:28.135006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:28.145248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2984eb34-cd8f-40c0-b027-12cc17dd25bf admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:28.150512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:28.151203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.151484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.151759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.152483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:28.154090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.164511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1050/2106] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:28.168426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:28.178298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c72b2c1-6b0f-4fab-a51f-b3132aed98ee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:28.183139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:28.183795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.184077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.184350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.185100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:28.186711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b65e8-d23f-4c09-8048-7dfde370fefb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.197983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1057/2107] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:28.201952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:28.212375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3b36a-bd56-4ec6-a7ed-c60fe42bebd6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:28.216938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:28.217807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.218119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.218392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] PATH_INFO: `/v3/projects/9db47afa9c0f4216b9d1a998dfaec1e4/users/3d9482180da947958cff0846d3e46b00/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.232934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9db47afa9c0f4216b9d1a998dfaec1e4, user_id=3d9482180da947958cff0846d3e46b00, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:28.235849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.252265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1051/2108] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:28 2022] PUT /identity/v3/projects/9db47afa9c0f4216b9d1a998dfaec1e4/users/3d9482180da947958cff0846d3e46b00/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:28.263524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d608-ac70-4396-b414-4384599e19ff None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.263815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d608-ac70-4396-b414-4384599e19ff None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.264095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5680d608-ac70-4396-b414-4384599e19ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.291542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5680d608-ac70-4396-b414-4384599e19ff None None] MFA Rules not processed for user `3d9482180da947958cff0846d3e46b00`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:28.292898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5680d608-ac70-4396-b414-4384599e19ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:28.360068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1058/2109] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:28.371876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:28.373696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:28.436126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e04bd43-fd15-45c9-b7e4-affd2f55f480 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:28.440294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:28.440944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:28.441226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:28.441545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:28.451135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:28.452637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:28.461633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1052/2110] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:28 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:30.258524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680d608-ac70-4396-b414-4384599e19ff None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:30.260005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5680d608-ac70-4396-b414-4384599e19ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:30.333354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5680d608-ac70-4396-b414-4384599e19ff None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:30.340101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:30.341008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:30.341326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:30.341605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] PATH_INFO: `/v3/users/a8a3882ead574edfa971c8da0b0bb0ee` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:30.342883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a3882ead574edfa971c8da0b0bb0ee)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:30.344826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:30.392160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a3882ead574edfa971c8da0b0bb0ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.403960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a3882ead574edfa971c8da0b0bb0ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.404660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a3882ead574edfa971c8da0b0bb0ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.405368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a3882ead574edfa971c8da0b0bb0ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.413739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a3882ead574edfa971c8da0b0bb0ee'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.427526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1059/2111] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:30 2022] DELETE /identity/v3/users/a8a3882ead574edfa971c8da0b0bb0ee => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:30.614317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:30.625753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd061be4-ec02-45a7-878b-bb10b72415f4 service glance] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:30.685527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:30.686393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:30.686710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:30.686989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] PATH_INFO: `/v3/projects/361145472124472da21819607fd4d79f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:30.688213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=361145472124472da21819607fd4d79f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:30.690120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:30.738980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '361145472124472da21819607fd4d79f', 'request_id': 'req-52f06702-c490-4425-aeaa-884f6e11de3a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.747004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '361145472124472da21819607fd4d79f', 'request_id': 'req-52f06702-c490-4425-aeaa-884f6e11de3a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.754942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '361145472124472da21819607fd4d79f', 'request_id': 'req-52f06702-c490-4425-aeaa-884f6e11de3a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.767494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] The token cache is being invalidate because project 361145472124472da21819607fd4d79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:30.767864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.768589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.770247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1053/2112] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:30 2022] DELETE /identity/v3/projects/361145472124472da21819607fd4d79f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:30.774888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:30.776614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:30.790632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8513b7-ed26-4837-a58f-c0638758f3f1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:30.851855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:30.853350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:30.853632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:30.853908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] PATH_INFO: `/v3/users/d3854d6a340949b3ac7cd5b29f0a98b6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:30.855125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3854d6a340949b3ac7cd5b29f0a98b6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:30.857036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:30.899510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3854d6a340949b3ac7cd5b29f0a98b6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.910797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3854d6a340949b3ac7cd5b29f0a98b6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.911465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3854d6a340949b3ac7cd5b29f0a98b6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.912066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3854d6a340949b3ac7cd5b29f0a98b6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.919843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e3fa267f-9c77-4253-92c0-d6a1be322bf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3854d6a340949b3ac7cd5b29f0a98b6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:30.932083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1060/2113] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:30 2022] DELETE /identity/v3/users/d3854d6a340949b3ac7cd5b29f0a98b6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:31.101780 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.103408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:31.116504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f06702-c490-4425-aeaa-884f6e11de3a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.176141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.177006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.177289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.177635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] PATH_INFO: `/v3/projects/60c4682244ce41f686b37b92d7decb43` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.178903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] RBAC: Authorizing `identity:delete_project(project_id=60c4682244ce41f686b37b92d7decb43)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.180951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.233348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60c4682244ce41f686b37b92d7decb43', 'request_id': 'req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:31.238683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60c4682244ce41f686b37b92d7decb43', 'request_id': 'req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:31.246818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60c4682244ce41f686b37b92d7decb43', 'request_id': 'req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:31.259770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] The token cache is being invalidate because project 60c4682244ce41f686b37b92d7decb43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:31.260062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:31.260727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b6e5a0b9-0d20-4fa0-b68b-88ea9684923c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:31.262278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1054/2114] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:31 2022] DELETE /identity/v3/projects/60c4682244ce41f686b37b92d7decb43 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:31.267472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.268062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.268062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.286385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:31.287650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:31.346171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1061/2115] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:31.354992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.355277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.355550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.374258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:31.375425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:31.384659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1055/2116] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:31.389173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.399291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2ef3d-ab87-41f2-a9b5-40170c6cca9d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.403842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.404427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.404707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.404977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.405690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:31.405989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.407605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.419011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1062/2117] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:31.423236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.432856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7d24-49bc-4826-b258-f95da3774b18 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.437484 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.438149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.438409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.438715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.439404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.441308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.470146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1056/2118] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:31.474435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.485013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d367b4-88eb-4595-9e16-c801bfd277e5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.545090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.545765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.546049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.546327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.547063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.548971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.568814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1063/2119] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:31.572426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.582406 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d0fe34-f48a-431d-923a-f2e18962e09e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.587820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.588501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.588784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.589087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.589794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.591468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.603148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1057/2120] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:31.607371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.617091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e1f2-19c9-4a23-997d-bd6d721808f3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.622556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.623241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.623523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.623801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.624515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.626096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5f9bf-4335-4a65-bc35-22a746fe2790 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.638377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1064/2121] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:31.642352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.652265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1d01-5c11-4abc-960a-7690d280e938 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.657054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.657925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.658127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.658382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] PATH_INFO: `/v3/projects/2b43ec4f9daa442bb301559a6200a5ae/users/cd6451718c814fcf814d0a225acbf52a/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.674228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b43ec4f9daa442bb301559a6200a5ae, user_id=cd6451718c814fcf814d0a225acbf52a, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.676935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.690370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1058/2122] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:31 2022] PUT /identity/v3/projects/2b43ec4f9daa442bb301559a6200a5ae/users/cd6451718c814fcf814d0a225acbf52a/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:31.700893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.701186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.701463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.727404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] MFA Rules not processed for user `cd6451718c814fcf814d0a225acbf52a`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:31.728760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:31.806262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1065/2123] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:31.811639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.872987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fcf19a-1773-42df-bbc6-8f1a760d8d50 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:31.878212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:31.878937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:31.879224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:31.879501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:31.880191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:31.882097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:31.910054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1059/2124] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:31.911145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:31.925353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08860c05-45c5-46e2-8f42-3f907c54483a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.013521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.014783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.015330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.015854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.017108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.020758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.051757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1066/2125] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:31 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:32.060735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.087355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c7537-56fd-4428-b0ae-32bf2f4aa625 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.093550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.094272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.094554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.094864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.095595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.097203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.111842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1060/2126] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:32.115090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.128365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148b752-c3cd-41cb-9109-fdd2fac78d59 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.134408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.135120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.135402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.135677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.136399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.138523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156380f2-8093-4e2b-964c-4729dcfdf746 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.149941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1067/2127] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:32.153955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.164072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86752044-77e0-4659-acc8-b995f605c15b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.169616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.170532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.170850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.171127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] PATH_INFO: `/v3/projects/7f2d3ee7838e42ebb03394ea4a5d9588/users/355d5484909f41b89256dd45e5348522/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.185692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2d3ee7838e42ebb03394ea4a5d9588, user_id=355d5484909f41b89256dd45e5348522, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.188391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.204450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1061/2128] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:32 2022] PUT /identity/v3/projects/7f2d3ee7838e42ebb03394ea4a5d9588/users/355d5484909f41b89256dd45e5348522/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:32.215771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.216167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.216606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.256942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] MFA Rules not processed for user `355d5484909f41b89256dd45e5348522`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:32.258697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:32.326080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1068/2129] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:32.330440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.392492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8208d42d-af23-4556-a7e3-a9594b17d1b2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.397515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.398288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.399150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.399605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.400363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.402360 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.432769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1062/2130] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:32 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:32.436663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.448201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d77680-750b-4b3a-8647-96c04b0b1472 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.503887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.504554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.504833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.505107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.505794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.507783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.528582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1069/2131] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:32 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:32.532569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.543497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b328008-fa58-4f14-935c-07fd0b57c841 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.548686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.549398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.549765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.550110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.550861 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.552567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.563350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1063/2132] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:32.568132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.578740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96047503-d265-47df-a62c-119bd03cf1ab admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.584637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.585614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.585903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.586862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] PATH_INFO: `/v3/projects/8f18128011a54b988ee53426148fcacd/users/6b6f2944f33e4338b4e11c5ae3be469d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.602297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f18128011a54b988ee53426148fcacd, user_id=6b6f2944f33e4338b4e11c5ae3be469d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.605015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.618386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1070/2133] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:32 2022] PUT /identity/v3/projects/8f18128011a54b988ee53426148fcacd/users/6b6f2944f33e4338b4e11c5ae3be469d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:32.622526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.632448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c2a56-2d03-4152-825b-2c233237074a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.689057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.689693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.689924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.690198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.691145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.692994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b279d-7c5a-41d3-a0f8-cf7585fa2773 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.707479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1064/2134] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:32.708730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.719433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c455e9b-f5bf-457b-b9e3-846fd0ce49f7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.723968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.724839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.725117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.725388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] PATH_INFO: `/v3/projects/8f18128011a54b988ee53426148fcacd/users/6b6f2944f33e4338b4e11c5ae3be469d/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.727380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f18128011a54b988ee53426148fcacd, user_id=6b6f2944f33e4338b4e11c5ae3be469d, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.730007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.740013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1071/2135] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:32 2022] PUT /identity/v3/projects/8f18128011a54b988ee53426148fcacd/users/6b6f2944f33e4338b4e11c5ae3be469d/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:32.750972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.751262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.751540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.778817 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] MFA Rules not processed for user `6b6f2944f33e4338b4e11c5ae3be469d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:32.780014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:32.845140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1065/2136] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:32.856605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:32.858357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:32.915998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50cd37b-294e-4c30-b1cf-f6040b4fd1dd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:32.919637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:32.920279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:32.920559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:32.920830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:32.981286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:32.982649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:32.991199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1072/2137] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:34.501552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:34.502971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:34.515353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dafada-d38e-40b1-a37c-d3c56e1af291 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:34.518922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:34.519563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:34.519872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:34.520149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:34.577169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:34.578638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:34.587355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1066/2138] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:35.124999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:35.133801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f5445-f0eb-4749-84c1-5556e890acff service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:35.138194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:35.139811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:35.140450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:35.140990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:35.153007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:35.154776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac79256-ce65-4bec-b8cb-68d4a9cc3acf service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:35.165547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1073/2139] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:38.238448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:38.240050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:38.310223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8469ded1-aa90-414b-a1a1-dc94aec2db27 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:38.314855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:38.315757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:38.316090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:38.316362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] PATH_INFO: `/v3/users/4e8d5674795342898f7a3ca2c348ec15` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:38.317819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e8d5674795342898f7a3ca2c348ec15)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:38.319756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:38.364566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e8d5674795342898f7a3ca2c348ec15'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.376457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e8d5674795342898f7a3ca2c348ec15'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.377205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e8d5674795342898f7a3ca2c348ec15'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.384696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e8d5674795342898f7a3ca2c348ec15'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.393210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e8d5674795342898f7a3ca2c348ec15'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.399315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1067/2140] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:38 2022] DELETE /identity/v3/users/4e8d5674795342898f7a3ca2c348ec15 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:38.404590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:38.405066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:38.405185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:38.421632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:38.422894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:38.481374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1074/2141] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:38.490845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:38.492248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:38.549985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3b683-c040-432f-a2a3-3b017e7d382f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:38.553644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:38.554302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:38.554595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:38.554894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:38.564230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:38.565763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b951f-7c99-4f43-82c1-a2ee2f1d57f3 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:38.576329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1068/2142] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:38.860413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:38.861874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:38.874704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed4837-01ed-431b-8b9f-c0ff1e1a778a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:38.879718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:38.880733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:38.880994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:38.881310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] PATH_INFO: `/v3/projects/d918058ed3cc4de0be0a9bfc96a36e12` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:38.882505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d918058ed3cc4de0be0a9bfc96a36e12)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:38.884556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:38.952167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd918058ed3cc4de0be0a9bfc96a36e12', 'request_id': 'req-5213bf83-7c53-48d9-a59b-4d22687504dc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.964068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd918058ed3cc4de0be0a9bfc96a36e12', 'request_id': 'req-5213bf83-7c53-48d9-a59b-4d22687504dc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.977636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd918058ed3cc4de0be0a9bfc96a36e12', 'request_id': 'req-5213bf83-7c53-48d9-a59b-4d22687504dc'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.993676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] The token cache is being invalidate because project d918058ed3cc4de0be0a9bfc96a36e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:38.994027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.995052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:38.997181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1075/2143] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:38 2022] DELETE /identity/v3/projects/d918058ed3cc4de0be0a9bfc96a36e12 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:39.005628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152843-441c-44dd-9917-363206e2d017 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.005919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152843-441c-44dd-9917-363206e2d017 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.006210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78152843-441c-44dd-9917-363206e2d017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.047457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-78152843-441c-44dd-9917-363206e2d017 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:39.057185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.058904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.059422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-78152843-441c-44dd-9917-363206e2d017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.151729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213bf83-7c53-48d9-a59b-4d22687504dc admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.157938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.159396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.160669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.160669 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] PATH_INFO: `/v3/users/cd6451718c814fcf814d0a225acbf52a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.162338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd6451718c814fcf814d0a225acbf52a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.165465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.178742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1069/2144] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:39.198371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.198893 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.199393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.231395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:39.233054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.270623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd6451718c814fcf814d0a225acbf52a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:39.279311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1070/2145] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:39.281916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd6451718c814fcf814d0a225acbf52a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:39.282873 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd6451718c814fcf814d0a225acbf52a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:39.283541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd6451718c814fcf814d0a225acbf52a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:39.284393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.293138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1825cc32-aa04-484d-88e0-63d6edd56baa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd6451718c814fcf814d0a225acbf52a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:39.295740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916f9d4-234a-4522-9401-1dfe2ce3f351 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.300742 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.301508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.302023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.302377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.303192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:39.303572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.305433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.309526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1076/2146] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:39 2022] DELETE /identity/v3/users/cd6451718c814fcf814d0a225acbf52a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:39.311079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.311431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.311769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.326758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1071/2147] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:14:39.327708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.329395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.333955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:39.335293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.343834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b862d-8a78-4525-af64-f39d2d9e732b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.405626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1077/2148] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:14:39.408336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.409193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.409515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.409838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.410708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.412640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.415751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.417523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.442117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1072/2149] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:39.446563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.475268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181353d-6d8e-4fa5-8bf6-b9e0840b36ef None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.512253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec8565-544d-4201-b272-641d92a9df75 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.517459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.518172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.518447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.518756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.519449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.521402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.536181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.537093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.537541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.537828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.543910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1073/2150] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:14:39.548107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.549454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.551300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.560904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8bd40-da89-49f0-9c9e-009391eaa1a1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.563831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1078/2151] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:39.566141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.567001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.567289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.567834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.568784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.570407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.581190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1074/2152] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:14:39.585426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.599050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aeb358-0cba-4c5b-8aba-234779650f04 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.606243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.607091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.607462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.607833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.608518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.610380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a99e5-6de7-41b7-919c-351db421ee61 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.623194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1079/2153] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:39.627312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.641003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0be97-9aa0-46ec-9a6f-4983b82ba897 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.646143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.647111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.647398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.647690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] PATH_INFO: `/v3/projects/62b4855dc9a2468eacd3d9ef4e2e450c/users/3c48e92a4fd240f693f1f2d271a27d97/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.663749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b4855dc9a2468eacd3d9ef4e2e450c, user_id=3c48e92a4fd240f693f1f2d271a27d97, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.667731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.684884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1075/2154] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:39 2022] PUT /identity/v3/projects/62b4855dc9a2468eacd3d9ef4e2e450c/users/3c48e92a4fd240f693f1f2d271a27d97/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:39.695987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.696528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.696893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.725409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] MFA Rules not processed for user `3c48e92a4fd240f693f1f2d271a27d97`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:39.726671 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.797238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1080/2155] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:39.808573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.810279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.869570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.871795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:39.874432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e08796-9029-44d9-9221-2fc797d585a3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.878173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.878932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.879144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.879402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.889363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.890934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.901839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1076/2156] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:14:39.928424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:39.956498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23294c1-12c6-482b-93ac-8f3d42886f2c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.961308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.962187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.962469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.968144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] PATH_INFO: `/v3/projects/2b43ec4f9daa442bb301559a6200a5ae` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.968144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b43ec4f9daa442bb301559a6200a5ae)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:39.968144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:39.991132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988db580-cca8-4f8b-9afd-aba7cfce532d service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:39.996459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:39.997422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:39.997711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:39.997987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] PATH_INFO: `/v3/users/3c48e92a4fd240f693f1f2d271a27d97` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:39.999300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c48e92a4fd240f693f1f2d271a27d97)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.001273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:40.013902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b43ec4f9daa442bb301559a6200a5ae', 'request_id': 'req-39a02d98-2cdc-489f-a447-07620b49a22f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.020286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b43ec4f9daa442bb301559a6200a5ae', 'request_id': 'req-39a02d98-2cdc-489f-a447-07620b49a22f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.029085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b43ec4f9daa442bb301559a6200a5ae', 'request_id': 'req-39a02d98-2cdc-489f-a447-07620b49a22f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.041527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] The token cache is being invalidate because project 2b43ec4f9daa442bb301559a6200a5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:40.042299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.042983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.044821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1081/2157] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:39 2022] DELETE /identity/v3/projects/2b43ec4f9daa442bb301559a6200a5ae => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:40.048478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:40.049064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c48e92a4fd240f693f1f2d271a27d97'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.049773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.064487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c48e92a4fd240f693f1f2d271a27d97'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.065195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c48e92a4fd240f693f1f2d271a27d97'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.074136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c48e92a4fd240f693f1f2d271a27d97'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.082987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e4cef54e-5e18-4608-b565-e27de566f4e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c48e92a4fd240f693f1f2d271a27d97'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.094516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1077/2158] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:39 2022] DELETE /identity/v3/users/3c48e92a4fd240f693f1f2d271a27d97 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:40.099664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.099959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.100231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.121761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:40.123226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.125122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a02d98-2cdc-489f-a447-07620b49a22f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:40.181094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1078/2159] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:40.183310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:40.184208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.184495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.185013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] PATH_INFO: `/v3/users/355d5484909f41b89256dd45e5348522` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.186314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=355d5484909f41b89256dd45e5348522)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.188287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:40.191709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:40.193350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.236098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '355d5484909f41b89256dd45e5348522'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.248167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '355d5484909f41b89256dd45e5348522'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.248837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '355d5484909f41b89256dd45e5348522'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.249450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '355d5484909f41b89256dd45e5348522'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.250815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ccdc6e-8b4b-46f0-b9fa-d77257a59e9f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:40.254503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:40.255184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.255463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.255740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.257059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '355d5484909f41b89256dd45e5348522'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.257560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.269697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1082/2160] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:40 2022] DELETE /identity/v3/users/355d5484909f41b89256dd45e5348522 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:14:40.269856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.271359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:40.283797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1079/2161] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:14:40.630727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:40.636608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.671911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:40.673559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.691920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db79f261-1702-4aa6-90b2-d730789a1edf service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:40.716183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb79d0e-ba62-4a35-b2cd-3b959f509f92 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:40.721139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:40.722040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.722319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.722619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] PATH_INFO: `/v3/projects/62b4855dc9a2468eacd3d9ef4e2e450c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.723797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b4855dc9a2468eacd3d9ef4e2e450c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.725763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:40.752136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:40.753007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.753291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.753565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] PATH_INFO: `/v3/projects/7f2d3ee7838e42ebb03394ea4a5d9588` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.754926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2d3ee7838e42ebb03394ea4a5d9588)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.756822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:40.772004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b4855dc9a2468eacd3d9ef4e2e450c', 'request_id': 'req-55efdef2-1bfb-4972-aa04-22a10351a401'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.779092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b4855dc9a2468eacd3d9ef4e2e450c', 'request_id': 'req-55efdef2-1bfb-4972-aa04-22a10351a401'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.789625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b4855dc9a2468eacd3d9ef4e2e450c', 'request_id': 'req-55efdef2-1bfb-4972-aa04-22a10351a401'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.803006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] The token cache is being invalidate because project 62b4855dc9a2468eacd3d9ef4e2e450c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:40.803304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.803983 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.805771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1083/2162] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:40 2022] DELETE /identity/v3/projects/62b4855dc9a2468eacd3d9ef4e2e450c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:40.809106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2d3ee7838e42ebb03394ea4a5d9588', 'request_id': 'req-cd481c65-c4c5-4e52-a95e-643a98c3a438'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.816194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2d3ee7838e42ebb03394ea4a5d9588', 'request_id': 'req-cd481c65-c4c5-4e52-a95e-643a98c3a438'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.824901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2d3ee7838e42ebb03394ea4a5d9588', 'request_id': 'req-cd481c65-c4c5-4e52-a95e-643a98c3a438'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.840028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] The token cache is being invalidate because project 7f2d3ee7838e42ebb03394ea4a5d9588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:40.840336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.841482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:40.843149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1080/2163] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:40 2022] DELETE /identity/v3/projects/7f2d3ee7838e42ebb03394ea4a5d9588 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:40.847335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:40.848823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:40.920235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55efdef2-1bfb-4972-aa04-22a10351a401 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:40.981875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:40.982946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:40.983230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:40.983505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] PATH_INFO: `/v3/users/6b6f2944f33e4338b4e11c5ae3be469d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:40.984765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6f2944f33e4338b4e11c5ae3be469d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:40.986735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.036590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6f2944f33e4338b4e11c5ae3be469d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.048500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6f2944f33e4338b4e11c5ae3be469d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.049171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6f2944f33e4338b4e11c5ae3be469d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.049783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6f2944f33e4338b4e11c5ae3be469d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.057424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ea5be65-296f-4606-98b8-1c6088cb5197 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6f2944f33e4338b4e11c5ae3be469d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.070317 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1084/2164] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:14:40 2022] DELETE /identity/v3/users/6b6f2944f33e4338b4e11c5ae3be469d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:41.342235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.343678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:41.357397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd481c65-c4c5-4e52-a95e-643a98c3a438 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.415795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.417341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.417615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.417894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] PATH_INFO: `/v3/projects/8f18128011a54b988ee53426148fcacd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.419349 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f18128011a54b988ee53426148fcacd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.421509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.472229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f18128011a54b988ee53426148fcacd', 'request_id': 'req-9170fe5c-dc6d-4450-835f-5aebf912e415'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.477299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f18128011a54b988ee53426148fcacd', 'request_id': 'req-9170fe5c-dc6d-4450-835f-5aebf912e415'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.484421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f18128011a54b988ee53426148fcacd', 'request_id': 'req-9170fe5c-dc6d-4450-835f-5aebf912e415'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.495962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] The token cache is being invalidate because project 8f18128011a54b988ee53426148fcacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:14:41.496250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.496963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9170fe5c-dc6d-4450-835f-5aebf912e415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:14:41.499169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1081/2165] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:14:41 2022] DELETE /identity/v3/projects/8f18128011a54b988ee53426148fcacd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:41.504424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.504807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.505195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.524172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:41.525356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:41.585319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1085/2166] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:41.593425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.593827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.594127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.614923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:41.616143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:41.624878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1082/2167] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:41.629039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.638527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620ef206-535e-4caf-8b82-c1f0063e64f2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.643141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.643796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.644073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.644339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.645048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:14:41.645349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.646959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.658229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1086/2168] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:14:41.662591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.672306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0154b05-df13-4caf-9f38-29daa6a8c923 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.677196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.677738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.678024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.678300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.679100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.680963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.709667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1083/2169] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:14:41 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:41.713905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.723627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e73408-a028-4edb-8468-4df9d20e297a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.779586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.780294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.780571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.780845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.781556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.783522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.804736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1087/2170] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:14:41 2022] POST /identity/v3/users => generated 286 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:14:41.808443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.818872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0941bc0-99fc-41f1-a868-58c6243df142 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.823970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.824656 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.824939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.825207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.825923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.827551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.837785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1084/2171] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:41.842163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.852845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abbb3e0-a5c0-4d14-b826-82c5075d20ee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.859031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.859807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.860222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.860511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.861290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.863112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c187c91-76b4-4218-a9b1-9ffcca74bb63 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.876431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1088/2172] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:14:41.880516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:41.890471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0c674-a66f-430a-9a8f-c3f7adaaf7b0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:41.895203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:41.896073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.896350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.896621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] PATH_INFO: `/v3/projects/cd30f1203062489fb5ba312ece27ae9e/users/7a7b7ea7c174411e8323720e5fa5790b/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:41.910957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd30f1203062489fb5ba312ece27ae9e, user_id=7a7b7ea7c174411e8323720e5fa5790b, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:41.913613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:41.926979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1085/2173] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:14:41 2022] PUT /identity/v3/projects/cd30f1203062489fb5ba312ece27ae9e/users/7a7b7ea7c174411e8323720e5fa5790b/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:14:41.998041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:41.998331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:41.998639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:42.024411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] MFA Rules not processed for user `7a7b7ea7c174411e8323720e5fa5790b`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:14:42.026175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:42.098374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1089/2174] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:14:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:14:42.110225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:14:42.112076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:14:42.168887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4828d-dd85-4a0b-9f44-3862a2d9113a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:14:42.172452 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:14:42.173099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:14:42.173407 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:14:42.173681 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:14:42.182602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:14:42.184288 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1072-098a-45db-9c75-2f6058a6e0db service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:14:42.193392 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1086/2175] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:14:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:01.927052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:01.928440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.063519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7daf7c-f340-4307-b6d8-e8a208b36149 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:02.068476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:02.069723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.070049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.070442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] PATH_INFO: `/v3/users/3d9482180da947958cff0846d3e46b00` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.072079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d9482180da947958cff0846d3e46b00)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:02.075639 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:02.124485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d9482180da947958cff0846d3e46b00'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.136667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d9482180da947958cff0846d3e46b00'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.137338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d9482180da947958cff0846d3e46b00'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.137943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d9482180da947958cff0846d3e46b00'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.145063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d9482180da947958cff0846d3e46b00'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.157032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1090/2176] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:15:01 2022] DELETE /identity/v3/users/3d9482180da947958cff0846d3e46b00 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:02.161535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.162051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.162148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.188379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:02.189699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.251016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1087/2177] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:02.260634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:02.262830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.355318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d82dcf-c335-43a3-b580-3c53e92f1c99 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:02.359122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:02.359776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.360061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.360346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.369778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:02.372069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705875b-b385-4899-b43f-ec4bb68ee355 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:02.382415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1091/2178] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:15:02.649375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:02.652480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.670885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7384de-f856-4ca6-a6d9-b3842e848f46 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:02.675843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:02.676658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.676869 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.677486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] PATH_INFO: `/v3/projects/9db47afa9c0f4216b9d1a998dfaec1e4` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.678399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9db47afa9c0f4216b9d1a998dfaec1e4)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:02.680384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:02.735022 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9db47afa9c0f4216b9d1a998dfaec1e4', 'request_id': 'req-a691149f-45e0-4c3c-a92d-77479e44e0c2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.740808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9db47afa9c0f4216b9d1a998dfaec1e4', 'request_id': 'req-a691149f-45e0-4c3c-a92d-77479e44e0c2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.749423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9db47afa9c0f4216b9d1a998dfaec1e4', 'request_id': 'req-a691149f-45e0-4c3c-a92d-77479e44e0c2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.762564 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] The token cache is being invalidate because project 9db47afa9c0f4216b9d1a998dfaec1e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:15:02.762885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.763549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a691149f-45e0-4c3c-a92d-77479e44e0c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:02.766795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1088/2179] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:15:02 2022] DELETE /identity/v3/projects/9db47afa9c0f4216b9d1a998dfaec1e4 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:02.773450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.773739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.774013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.822625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:02.824137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.884367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1092/2180] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:15:02.892012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.892300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.892579 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.911168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:02.912472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:02.922552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1089/2181] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:02.927658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:02.938766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a0ba-4811-467b-aba2-6ec990b880d3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:02.943925 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:02.944607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.944888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.945161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.945887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:15:02.946195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:02.947904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:02.960800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1093/2182] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:15:02.966420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:02.976507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e33935-5973-4662-bec7-f01dc71fa36a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:02.982440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:02.983143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:02.983442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:02.983714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:02.984460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:02.986344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.011596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1090/2183] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:15:02 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:15:03.015884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:03.025237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddd4e07-1d0c-4fa4-a6ed-bd8abe1e6b65 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:03.087936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:03.089039 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.090556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.090898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.091606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:03.093552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.114252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1094/2184] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:15:03 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:15:03.118290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:03.128924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c2f267-826a-498c-b6fc-546863b77403 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:03.133783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:03.134439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.134755 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.135031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.135744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:03.138206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.150039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1091/2185] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:15:03.153452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:03.163110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25172ea-713b-439c-b68e-ce6d4fed7b4a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:03.167695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:03.168356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.168633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.168905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.169623 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:03.171227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990536bf-a1e6-494a-adb6-1b1046c6812f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.181161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1095/2186] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:15:03.185264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:03.195927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4779fa-61d2-43ba-a959-120a15b0a2e4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:03.201414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:03.202485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.202802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.203079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] PATH_INFO: `/v3/projects/a0b25b97710c4115871b094e03709347/users/759c9a68b8044d1a92b73f18c8f09d4d/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.218708 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0b25b97710c4115871b094e03709347, user_id=759c9a68b8044d1a92b73f18c8f09d4d, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:03.221486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.236752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1092/2187] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:15:03 2022] PUT /identity/v3/projects/a0b25b97710c4115871b094e03709347/users/759c9a68b8044d1a92b73f18c8f09d4d/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:03.241839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340224a-7978-4db5-8ded-95c1a639a8e8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.242132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340224a-7978-4db5-8ded-95c1a639a8e8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.242408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0340224a-7978-4db5-8ded-95c1a639a8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.262071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0340224a-7978-4db5-8ded-95c1a639a8e8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:03.262882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0340224a-7978-4db5-8ded-95c1a639a8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:03.323011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1096/2188] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:03.332863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:03.334666 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:03.390654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7346c56e-63f5-4e16-a128-ffdc999fbdab admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:03.394467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:03.395146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:03.395428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:03.395703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:03.408773 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:03.410219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7b74e-5291-4d8f-be34-4a034c94ef5b service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:03.420169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1093/2189] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:08.540366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:08.541337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:08.541797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:08.584339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] MFA Rules not processed for user `c7b641ce301a4b7685f0f70d7ac4a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:08.588628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:08.667456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1097/2190] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:09.798211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:09.798762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:09.798880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:09.827307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] MFA Rules not processed for user `759c9a68b8044d1a92b73f18c8f09d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:09.828786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:09.944430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1094/2191] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:09.949486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:09.961013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45a234-40f6-4e06-8870-83e4ae08c87e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:09.967318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:09.968206 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:09.968668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:09.969090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:09.969954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:09.972133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.033601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:10.034903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1098/2192] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:15:09 2022] POST /identity/v3/projects => generated 383 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:15:10.047424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac52b5-b286-4d26-b73f-e225b7967803 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:10.176527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:10.177219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:10.177499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:10.177768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:10.178660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:10.181099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.214276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1095/2193] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:15:10 2022] POST /identity/v3/users => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:15:10.218397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:10.234872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ecdebe-9d20-42ae-b7ed-5f1ab7c07aff admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:10.241565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:10.244489 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:10.246022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:10.246850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:10.247948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:10.254464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.303934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1099/2194] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:15:10.305605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:10.320126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc289a9-f211-4779-a80b-626ff8faf15f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:10.335055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:10.336239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:10.336679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:10.337156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] PATH_INFO: `/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3/users/42de5397cd0a496fa5e36de8724fbc56/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:10.364534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79816a28b5147a0bf90d2fd125dbcd3, user_id=42de5397cd0a496fa5e36de8724fbc56, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:10.369188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.384250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1096/2195] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:15:10 2022] PUT /identity/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3/users/42de5397cd0a496fa5e36de8724fbc56/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:10.388651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:10.400314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6823a-13cc-47aa-a72d-41d2835bb6da admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:10.472820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:10.473523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:10.473799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:10.474067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:10.474815 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:10.476425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac114a-ed37-45c4-bdc7-a226a16cb11b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.489898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1100/2196] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:15:10.490824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:10.501952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3666b20-fafa-43cf-afba-282ee3341bdd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:10.508109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:10.509514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:10.510323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:10.510892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] PATH_INFO: `/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3/users/42de5397cd0a496fa5e36de8724fbc56/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:10.516245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79816a28b5147a0bf90d2fd125dbcd3, user_id=42de5397cd0a496fa5e36de8724fbc56, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:10.520548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062498d5-dbf3-4d0d-87a2-9287fd05f46d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:10.538103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1097/2197] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:15:10 2022] PUT /identity/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3/users/42de5397cd0a496fa5e36de8724fbc56/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:14.953813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:14.954277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:14.954381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:14.973397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] MFA Rules not processed for user `62a9f27a865b468989f672a05dbab350`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:14.974640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:15.047518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1101/2198] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:17.359155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039f29-c230-4c79-a973-15f45758bf60 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:17.359155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039f29-c230-4c79-a973-15f45758bf60 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:17.359155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9039f29-c230-4c79-a973-15f45758bf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:17.390924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a9039f29-c230-4c79-a973-15f45758bf60 None None] MFA Rules not processed for user `42de5397cd0a496fa5e36de8724fbc56`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:17.392334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a9039f29-c230-4c79-a973-15f45758bf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:17.465852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1098/2199] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:17.477474 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:17.478914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:17.553977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97f7c2-db6d-461b-983c-1d2af1a644a1 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:17.559721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:17.560967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:17.561265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:17.561545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:17.626480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:17.628046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:17.637840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1102/2200] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:17.750346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2b6fa-c60a-4275-930e-9bc111f150a5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:17.750670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2b6fa-c60a-4275-930e-9bc111f150a5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:17.750951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df2b6fa-c60a-4275-930e-9bc111f150a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:17.780711 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6df2b6fa-c60a-4275-930e-9bc111f150a5 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:17.781901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6df2b6fa-c60a-4275-930e-9bc111f150a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:17.841531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1099/2201] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:15:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:17.885010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:17.886529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:17.969717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc126adc-1eff-40fa-874c-e6c13294423f service glance] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:17.978548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:17.980158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:17.980625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:17.981261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:17.991702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:17.993620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:18.004537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1103/2202] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:15:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:15:27.819863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:27.820871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:27.821315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:27.845663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:27.847196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:27.855324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1100/2203] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:27.873505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:27.895145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948b0e3-2014-4d12-8054-4931c7aa3f82 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:27.913355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:27.914755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:27.915231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:27.915705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:27.939491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:27.944596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e0ba7-ea09-4bad-bcaf-b56f3467ed4d service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:27.961836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1104/2204] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:15:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:15:28.599144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:28.600957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:28.794051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de59c9c-e28c-46a3-9c3b-8a456d1fc78e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:28.813292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:28.815098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:28.815098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:28.815098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] PATH_INFO: `/v3/users/7a7b7ea7c174411e8323720e5fa5790b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:28.816258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7b7ea7c174411e8323720e5fa5790b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:28.819306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:28.892975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7b7ea7c174411e8323720e5fa5790b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:28.922040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7b7ea7c174411e8323720e5fa5790b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:28.924870 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7b7ea7c174411e8323720e5fa5790b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:28.948305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7b7ea7c174411e8323720e5fa5790b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:28.961771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7b7ea7c174411e8323720e5fa5790b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:28.974240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1101/2205] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:15:28 2022] DELETE /identity/v3/users/7a7b7ea7c174411e8323720e5fa5790b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:28.976544 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:28.977063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:28.977148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.027012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:29.028597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:29.186368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1105/2206] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:29.202404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:29.204045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:29.377243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c50407d-2f8f-4d52-8cab-c162e202b3fb admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:29.392594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:29.393408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:29.393701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:29.393983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:29.422540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:29.424008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d29cf-3a58-486b-9d2a-e50ac8e8f76c service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:29.460076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1102/2207] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:30.165776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:30.168503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:30.196106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609673-3d04-4584-a572-4dcd049805b5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:30.214964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:30.215875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:30.216159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:30.216637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] PATH_INFO: `/v3/projects/cd30f1203062489fb5ba312ece27ae9e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:30.218277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd30f1203062489fb5ba312ece27ae9e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:30.221565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:30.304125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd30f1203062489fb5ba312ece27ae9e', 'request_id': 'req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:30.311149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd30f1203062489fb5ba312ece27ae9e', 'request_id': 'req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:30.323989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd30f1203062489fb5ba312ece27ae9e', 'request_id': 'req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:30.338410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] The token cache is being invalidate because project cd30f1203062489fb5ba312ece27ae9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:15:30.339252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:30.340167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c8c03445-9cfd-4845-a7a4-16b7d4cf958d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:15:30.342431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1106/2208] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:15:30 2022] DELETE /identity/v3/projects/cd30f1203062489fb5ba312ece27ae9e => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:15:30.645863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eeeaf-3988-4ecd-8e04-dc531fffa6bf None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:30.646872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eeeaf-3988-4ecd-8e04-dc531fffa6bf None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:30.647486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8eeeaf-3988-4ecd-8e04-dc531fffa6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:30.676453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1e8eeeaf-3988-4ecd-8e04-dc531fffa6bf None None] MFA Rules not processed for user `759c9a68b8044d1a92b73f18c8f09d4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:30.680866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1e8eeeaf-3988-4ecd-8e04-dc531fffa6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:30.761688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1103/2209] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:36.762369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:36.763058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:36.763271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:36.800555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] MFA Rules not processed for user `fc7eae5aa3594459bea417a96aae7d8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:36.802237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:36.966030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1107/2210] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:38.047930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:38.049098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:38.049704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:38.173059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:38.174348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:38.356714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1104/2211] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:15:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:38.370811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:38.372252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:38.631893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045092f9-4b69-4bd7-a5a8-c44f449b293c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:38.654942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:38.657055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:38.657506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:38.658195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:38.672584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:38.674625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:38.686668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1108/2212] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:15:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:15:55.280578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:55.282249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:55.349995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:55.356178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:55.467389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ba198a-9271-4054-bf53-ffb8160307c5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:55.473317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:55.474319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:55.475568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:55.476054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:55.478842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:55.504436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:55.508008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfaca8e-425a-450b-9c79-096d9d99842e service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:55.532521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1105/2213] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:55.578536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb96e9-e044-4506-ad13-7228906f2651 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:55.584357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:55.585185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:55.585636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:55.586123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:55.595969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:55.597821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75961313-b8a2-4580-87d8-16f9ecb81eaf service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:55.609057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1109/2214] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:15:57.513202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.513759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.513759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.515178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1106/2215] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 17 18:15:57.521638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f10ac-f1c9-4eb8-bd01-168befecdc84 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.522596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f10ac-f1c9-4eb8-bd01-168befecdc84 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.523268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f10ac-f1c9-4eb8-bd01-168befecdc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.577295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f79f10ac-f1c9-4eb8-bd01-168befecdc84 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:57.578561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f79f10ac-f1c9-4eb8-bd01-168befecdc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:57.663935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1110/2216] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:57.681324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:57.683416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:57.777249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2db83-1dda-4bbb-8afc-ef45a6227c7e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:57.780901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:57.781555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.781840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.782116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.793654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:57.795216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884e7cb8-6438-4028-87d7-ccafae1c57b9 service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:57.806736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1107/2217] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:57.877137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.877363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.877674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.879255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1111/2218] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:15:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:57.883955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3729-8914-41c9-8a82-0e91331c5f33 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.884273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3729-8914-41c9-8a82-0e91331c5f33 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.884521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed3729-8914-41c9-8a82-0e91331c5f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.902461 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eaed3729-8914-41c9-8a82-0e91331c5f33 None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:57.903693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eaed3729-8914-41c9-8a82-0e91331c5f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:57.957404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1108/2219] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:15:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:57.969600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:57.971347 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:57.984883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19935d-985f-4fc2-a249-7f8d76126a78 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:57.988365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:57.989017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:57.989297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:57.989571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:57.999113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:58.000588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e43b-6a15-4686-b328-5ceb5fc66704 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:58.014147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1112/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:15:58.199378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:58.199669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:58.199970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:58.201363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1109/2221] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:15:58.207031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f910e-b3d3-4236-a48a-b1452ffb15a4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:58.207859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f910e-b3d3-4236-a48a-b1452ffb15a4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:58.208167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f910e-b3d3-4236-a48a-b1452ffb15a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:58.226239 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f99f910e-b3d3-4236-a48a-b1452ffb15a4 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:15:58.227581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f99f910e-b3d3-4236-a48a-b1452ffb15a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:58.237411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1113/2222] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:15:58.252690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:15:58.255713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:15:58.275057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580bd34-da49-4593-9d5e-8e2e55ae99bb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:15:58.278721 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:15:58.279359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:15:58.279636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:15:58.279911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:15:58.290800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:15:58.292228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:15:58.303115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1110/2223] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:15:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:16:01.256171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad15d2-792e-4f55-b3b1-3a5bad3259f6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:01.256171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad15d2-792e-4f55-b3b1-3a5bad3259f6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:01.256171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad15d2-792e-4f55-b3b1-3a5bad3259f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:01.273640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-44ad15d2-792e-4f55-b3b1-3a5bad3259f6 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:16:01.275107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-44ad15d2-792e-4f55-b3b1-3a5bad3259f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:16:01.282111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1114/2224] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:16:01.294154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:16:01.305054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d379eb-0f5f-47ed-8d0a-ae9be9dd0eb6 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:16:01.310636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:16:01.311222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:01.311504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:01.311781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:01.319885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:16:01.322123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:16:01.330319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1111/2225] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:16:36.111908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:36.112490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:36.112658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:36.131832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:16:36.133619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:16:36.140911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1115/2226] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:16:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:16:36.166986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:16:36.178061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c692a-5ca4-4a36-b7ea-920ad0d513e3 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:16:36.184696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:16:36.185438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:36.185789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:36.186150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:36.195120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:16:36.196739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadf58f5-4424-406d-a0b6-801145b4c73c service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:16:36.205223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1112/2227] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:16:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:16:37.729506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:16:37.739915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d20a7-34e2-4387-9f50-574191bf4bd8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:16:37.744488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:16:37.745401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:37.745899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:37.746242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:37.748622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:16:37.816482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:16:37.818159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:16:37.827590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1116/2228] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:16:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:16:47.091766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:16:47.092295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:16:47.092393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:16:47.110120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] MFA Rules not processed for user `c7b641ce301a4b7685f0f70d7ac4a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:16:47.111341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:16:47.164107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1113/2229] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:09.699472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:09.701154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:09.763236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d597c5c1-5b09-4e8c-ba84-1ebc92e49225 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:09.767621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:09.768484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:09.768758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:09.769023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] PATH_INFO: `/v3/users/fc7eae5aa3594459bea417a96aae7d8d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:09.770185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc7eae5aa3594459bea417a96aae7d8d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:09.772343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:09.815105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc7eae5aa3594459bea417a96aae7d8d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:09.827520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc7eae5aa3594459bea417a96aae7d8d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:09.828191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc7eae5aa3594459bea417a96aae7d8d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:09.828797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc7eae5aa3594459bea417a96aae7d8d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:09.836130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-73eda037-3274-4dad-9bea-097df3d683f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc7eae5aa3594459bea417a96aae7d8d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:09.847900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1117/2230] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:17:09 2022] DELETE /identity/v3/users/fc7eae5aa3594459bea417a96aae7d8d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:10.015508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:10.029548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98de9e-a1d2-4685-b553-d931595b2f1d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:10.086254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:10.087352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:10.087683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:10.088017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] PATH_INFO: `/v3/projects/76d421fe5f96421db7d4eeedd205b462` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:10.089262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] RBAC: Authorizing `identity:delete_project(project_id=76d421fe5f96421db7d4eeedd205b462)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:10.091193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:10.134816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76d421fe5f96421db7d4eeedd205b462', 'request_id': 'req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:10.139949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76d421fe5f96421db7d4eeedd205b462', 'request_id': 'req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:10.146705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76d421fe5f96421db7d4eeedd205b462', 'request_id': 'req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:10.157268 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] The token cache is being invalidate because project 76d421fe5f96421db7d4eeedd205b462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:17:10.157483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:10.158129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-91eca6a7-1d6b-4cc3-a2a1-e4fd67a0638a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:17:10.159693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1114/2231] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:17:10 2022] DELETE /identity/v3/projects/76d421fe5f96421db7d4eeedd205b462 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:17:19.979559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:19.980073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:19.980197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:19.997854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] MFA Rules not processed for user `62a9f27a865b468989f672a05dbab350`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:19.999103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:20.053787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1118/2232] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:17:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:29.628857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:29.629371 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:29.629482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:29.648616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] MFA Rules not processed for user `8ba97b67ecf64476a630fd3667d617fb`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:17:29.649739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:29.703932 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1115/2233] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:17:50.573721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:50.575161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:50.651092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d90246-7993-4036-98b2-a62b5028064b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:50.654693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:50.655365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:50.655646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:50.655920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:50.657681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:50.729178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:50.730552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:50.743660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1119/2234] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:17:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:52.015523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:52.025988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c5a7-aef3-4a23-a514-46fb5224cf81 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:52.029634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:52.030274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:52.030557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:52.030868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:52.032610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:52.090099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:52.091495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655f6a-41b2-42bd-bfb8-c26959243af1 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:52.100383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1116/2235] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:17:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:17:57.788156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:17:57.789608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.843709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918e3a-a0a7-4e8a-9afb-ace86cf2c80e service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:17:57.847231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:17:57.847865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:17:57.848146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:17:57.848416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:17:57.850136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:17:57.862859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:17:57.864747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:17:57.875130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1120/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:17:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:05.729880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:05.730428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:05.730428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:05.751785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] MFA Rules not processed for user `17c2097983df461eb7c23bc0ed7b7520`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:05.753168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:05.813792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1117/2237] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:05 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:06.140292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:06.150119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b5c5a-8987-4fc3-92d3-ca77347a4038 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:06.153882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:06.154526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:06.154844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:06.155123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:06.156914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:06.166761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:06.168248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d24d43-c865-4305-b8c7-1e3b51f79553 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:06.176419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1121/2238] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:06.528718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:06.530110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:06.608898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c7c83-9584-4301-901f-61aed0dbd34c None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:06.615193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:06.615850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:06.616135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:06.616413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:06.618213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:06.630598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:06.632166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:06.642228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1118/2239] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:07.036899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.037219 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.037499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.055723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] MFA Rules not processed for user `c7b641ce301a4b7685f0f70d7ac4a5d3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:07.056564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.063575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1122/2240] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:07.397604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.406446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac842968-d8e9-4453-991c-2d0446b7bec6 service placement] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.409969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.410709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.411017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.411291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.413015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.422052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.423491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.431646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1119/2241] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:07.586199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:07.587625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.602753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f469e78-0258-43ed-a00f-263debd9af48 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:07.608122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:07.608767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:07.609045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:07.609319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:07.611332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:07.622171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:07.623765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:07.633821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1123/2242] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:08.229197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:08.242303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b91f-0ad2-4f30-824d-1f9cafc5e71d service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:08.247695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:08.248326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:08.248604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:08.248877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:08.250627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:08.261520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:08.263142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:08.271794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1120/2243] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:10.372515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:10.382425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40d3f7-abe9-4916-a770-561b4ab4c66e service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:10.386053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:10.386947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:10.387569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:10.388186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:10.393424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:10.404992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:10.406441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0136be4-fa34-437b-8e7f-b3d2edd4876f service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:10.415224 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1124/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:13.195911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:13.197548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:13.217789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c34f4d-4494-4776-be38-ac327faeca37 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:13.230145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:13.230839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:13.231110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:13.231385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:13.236071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:13.286937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:13.288971 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:13.309290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1121/2245] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:22.665708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.666198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.666446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.684856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:22.686284 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.750343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1125/2246] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:18:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:22.801098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:22.802514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:22.870513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34eca07-3ff3-44fc-b43c-dbb0636dd057 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:22.875465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:22.876117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:22.876400 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:22.876684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:22.885995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:22.887609 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:22.896968 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1122/2247] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:18:23.330836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:23.346013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111819bb-0fe5-4570-a110-cd7af933bb3f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:23.357442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:23.358512 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:23.358967 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:23.359526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:23.361363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:23.373608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:23.375563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:23.386924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1126/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:25.102879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:25.118333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6b7225-476a-4291-bfc2-4e0dd71c300f service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:25.126095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:25.126792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:25.127714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:25.128190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:25.130851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:25.145433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:25.147146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:25.158427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1123/2249] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:29.248949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:29.260419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84881c7-5da0-46e1-bc80-d7f1f95877fe service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:29.264592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:29.265644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:29.266140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:29.266654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:29.268715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:29.341063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:29.342857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:29.353609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1127/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:30.277710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:30.300399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6b50c-969f-444e-9321-2a6f6d51bb15 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:30.314314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:30.315940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:30.316646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:30.317129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:30.327748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:30.349327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:30.351218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:30.375014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1124/2251] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:32.083992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:32.086366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:32.125777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d34a9b-ba3c-4dd9-97c3-c3a6b5a5c0f2 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:32.132141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:32.137584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:32.138083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:32.138991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] PATH_INFO: `/v3/users/759c9a68b8044d1a92b73f18c8f09d4d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:32.141673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=759c9a68b8044d1a92b73f18c8f09d4d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:32.145367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:32.218364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '759c9a68b8044d1a92b73f18c8f09d4d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.244508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '759c9a68b8044d1a92b73f18c8f09d4d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.245378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '759c9a68b8044d1a92b73f18c8f09d4d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.246696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '759c9a68b8044d1a92b73f18c8f09d4d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.259137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '759c9a68b8044d1a92b73f18c8f09d4d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.281126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1128/2252] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:32 2022] DELETE /identity/v3/users/759c9a68b8044d1a92b73f18c8f09d4d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:32.480630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:32.491956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63e35c-573a-4ba8-b1a5-d1f115ea7028 service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:32.571086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:32.572024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:32.572270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:32.572713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] PATH_INFO: `/v3/projects/a0b25b97710c4115871b094e03709347` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:32.577547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0b25b97710c4115871b094e03709347)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:32.583182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:32.648788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0b25b97710c4115871b094e03709347', 'request_id': 'req-e8027eb4-fada-4d77-8815-d5581fc1b9f2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.655217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0b25b97710c4115871b094e03709347', 'request_id': 'req-e8027eb4-fada-4d77-8815-d5581fc1b9f2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.666157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0b25b97710c4115871b094e03709347', 'request_id': 'req-e8027eb4-fada-4d77-8815-d5581fc1b9f2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.682079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] The token cache is being invalidate because project a0b25b97710c4115871b094e03709347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:32.682471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.683350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.687984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1125/2253] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:32 2022] DELETE /identity/v3/projects/a0b25b97710c4115871b094e03709347 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:32.689201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:32.691238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:32.712608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729e088-8d25-4c51-8551-42dcc65e2bc7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:32.791429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:32.792545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:32.792938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:32.793223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] PATH_INFO: `/v3/users/42de5397cd0a496fa5e36de8724fbc56` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:32.794611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42de5397cd0a496fa5e36de8724fbc56)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:32.796982 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:32.856726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42de5397cd0a496fa5e36de8724fbc56'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.869916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42de5397cd0a496fa5e36de8724fbc56'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.871057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42de5397cd0a496fa5e36de8724fbc56'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.871730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42de5397cd0a496fa5e36de8724fbc56'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.880595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42de5397cd0a496fa5e36de8724fbc56'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:32.901273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1129/2254] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:32 2022] DELETE /identity/v3/users/42de5397cd0a496fa5e36de8724fbc56 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:33.117586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:33.119597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:33.140682 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8027eb4-fada-4d77-8815-d5581fc1b9f2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:33.214483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:33.215667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:33.215947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:33.216222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] PATH_INFO: `/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:33.217430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79816a28b5147a0bf90d2fd125dbcd3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:33.219410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:33.288723 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79816a28b5147a0bf90d2fd125dbcd3', 'request_id': 'req-55925954-513c-4cfb-b017-1a4348b65485'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:33.294838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79816a28b5147a0bf90d2fd125dbcd3', 'request_id': 'req-55925954-513c-4cfb-b017-1a4348b65485'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:33.303792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79816a28b5147a0bf90d2fd125dbcd3', 'request_id': 'req-55925954-513c-4cfb-b017-1a4348b65485'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:33.318840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] The token cache is being invalidate because project f79816a28b5147a0bf90d2fd125dbcd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:33.319397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:33.320205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:33.321941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1126/2255] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:33 2022] DELETE /identity/v3/projects/f79816a28b5147a0bf90d2fd125dbcd3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:34.906487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:34.908016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:34.922825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81677f10-be13-41eb-92ca-577db6dadcb0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:34.979203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:34.980085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:34.980382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:34.980673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] PATH_INFO: `/v3/users/62a9f27a865b468989f672a05dbab350` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:34.981847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a9f27a865b468989f672a05dbab350)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:34.983784 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.029321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a9f27a865b468989f672a05dbab350'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.041801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a9f27a865b468989f672a05dbab350'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.042459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a9f27a865b468989f672a05dbab350'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.043089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a9f27a865b468989f672a05dbab350'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.050828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4af5e708-7a42-499d-94ac-162e48caf0b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a9f27a865b468989f672a05dbab350'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.062686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1130/2256] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:34 2022] DELETE /identity/v3/users/62a9f27a865b468989f672a05dbab350 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:35.233071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.234543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.249594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55925954-513c-4cfb-b017-1a4348b65485 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.305395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.306257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.306540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.306850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] PATH_INFO: `/v3/projects/e32e7b68f0464827afc5ed835cee1d15` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.308033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32e7b68f0464827afc5ed835cee1d15)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.310010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.355474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32e7b68f0464827afc5ed835cee1d15', 'request_id': 'req-64043e7c-8271-4664-9cce-709d88ea49ba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.360771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32e7b68f0464827afc5ed835cee1d15', 'request_id': 'req-64043e7c-8271-4664-9cce-709d88ea49ba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.367843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32e7b68f0464827afc5ed835cee1d15', 'request_id': 'req-64043e7c-8271-4664-9cce-709d88ea49ba'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.379202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] The token cache is being invalidate because project e32e7b68f0464827afc5ed835cee1d15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:35.379489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.380117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-64043e7c-8271-4664-9cce-709d88ea49ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:35.381668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1127/2257] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:35 2022] DELETE /identity/v3/projects/e32e7b68f0464827afc5ed835cee1d15 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:35.386833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.387119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.387394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.405452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:35.406653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.465364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1131/2258] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:35.472949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.473244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.473520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.491135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:35.492319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.500119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1128/2259] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:35.504693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.514081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183316b-1ed8-4cf6-8eb9-c927459097a5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.519449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.519946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.520227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.520499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.521250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:35.521538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.523147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.534166 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1132/2260] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:18:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:35.538238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.547193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05f42d-64aa-4aef-9804-1236ab98a96b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.552187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.552834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.553119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.553398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.554077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.556008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.582693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1129/2261] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:35.587036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.597087 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca74df1-4900-464a-9705-d490ab9dd742 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.654122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.654828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.655114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.655387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.656079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.658117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.679124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1133/2262] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:18:35.683348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.694368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb593371-ccba-4da4-ace8-407ea6d769b1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.699145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.700684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.700974 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.701250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.701997 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.703630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.714391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1130/2263] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:35.718384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.728412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72692027-e371-45a9-b87c-164955f03d5a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.733156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.733866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.734153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.734426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.735183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.736783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0705ff4-48ee-40ad-9039-caf75efcc3e8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.747575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1134/2264] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:35.751787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.763137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39700-38e7-4a77-b95a-859ca9f0a70f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.767698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.768685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.768969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.769235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] PATH_INFO: `/v3/projects/f55951b56e9748f3961f0a6e356fa8f3/users/64e63bfb715f41e587349ed09b1b057c/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.783070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f55951b56e9748f3961f0a6e356fa8f3, user_id=64e63bfb715f41e587349ed09b1b057c, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.785800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.798239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1131/2265] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:35 2022] PUT /identity/v3/projects/f55951b56e9748f3961f0a6e356fa8f3/users/64e63bfb715f41e587349ed09b1b057c/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:35.808833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.809178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.809462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.836521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] MFA Rules not processed for user `64e63bfb715f41e587349ed09b1b057c`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:35.837717 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.901048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1135/2266] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:35.912059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:35.913744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:35.970880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059987-f93b-4b8a-bb0c-4858d6e5ed14 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:35.975233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:35.975891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:35.976174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:35.976451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:35.985032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:35.986522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875b7b6-5a3c-4798-b01b-8aab5b06ad44 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:35.995884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1132/2267] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:35 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:44.200584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.260555 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe17f-6fb6-4556-83dd-55c3a835551f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.265052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.265923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.266204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.266472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] PATH_INFO: `/v3/users/64e63bfb715f41e587349ed09b1b057c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.267688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] RBAC: Authorizing `identity:delete_user(user_id=64e63bfb715f41e587349ed09b1b057c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.269817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.312945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64e63bfb715f41e587349ed09b1b057c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.325126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64e63bfb715f41e587349ed09b1b057c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.325775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64e63bfb715f41e587349ed09b1b057c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.326364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64e63bfb715f41e587349ed09b1b057c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.333650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64e63bfb715f41e587349ed09b1b057c'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.345097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1136/2268] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:44 2022] DELETE /identity/v3/users/64e63bfb715f41e587349ed09b1b057c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:44.349702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.350198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.350305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.367286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:44.368460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.425772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1133/2269] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:44.435301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.436667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.491930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a1d40-a7bd-463e-bc0c-c2123814bdea admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.495646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.496292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.496569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.496838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.506053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.507554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45146617-0ffd-4c4b-a725-423da734004c service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.516840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1137/2270] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:44.786123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:44.787618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.799750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f71cb21-8ab8-4797-bd31-b2dad499d8f8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:44.806161 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:44.807152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.807508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.807909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] PATH_INFO: `/v3/projects/f55951b56e9748f3961f0a6e356fa8f3` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.809198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f55951b56e9748f3961f0a6e356fa8f3)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:44.811159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:44.859103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f55951b56e9748f3961f0a6e356fa8f3', 'request_id': 'req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.864320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f55951b56e9748f3961f0a6e356fa8f3', 'request_id': 'req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.871661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f55951b56e9748f3961f0a6e356fa8f3', 'request_id': 'req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.883080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] The token cache is being invalidate because project f55951b56e9748f3961f0a6e356fa8f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:44.883370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.883996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e23ae1f-dbdc-4841-9fa5-3e929cac3d1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:44.885540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1134/2271] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:44 2022] DELETE /identity/v3/projects/f55951b56e9748f3961f0a6e356fa8f3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:44.892071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.892355 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.892627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.910490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:44.911693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:44.969241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1138/2272] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:44.977194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:44.977594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:44.977967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:44.997220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:44.998388 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.006221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1135/2273] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:45.010493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.020748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a56478-eef6-4c5c-aad3-2a32135d7b1d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.025262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.025926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.026199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.026475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.027228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:45.027532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.029110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.040792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1139/2274] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:45.050347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.059414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b95163a-ed1b-4937-b7c9-f7b355aeddc6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.063990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.064633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.064920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.065465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.065901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.068058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.092367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1136/2275] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:45.097386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.107205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a926cb5-4732-4c42-b8d2-410e558fd7f3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.161001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.161668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.161951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.162223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.163007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.164861 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.185175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1140/2276] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:45.189581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.201374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a76b4-c481-44a4-a8b9-c62e2a16c389 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.208025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.208696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.208982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.209262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.209993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.211638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.222641 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1137/2277] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:45.226652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.236746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb57b8-067f-46e8-a3af-f5b92fc034eb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.241845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.242520 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.242836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.243112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.243833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.245429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05585a8-50fb-4a3d-ac84-333ed235850c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.256548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1141/2278] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:45.260808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.270829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d3fb6-280e-4a3f-94f0-5d0156925ee1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.275431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.276313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.276595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.276863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] PATH_INFO: `/v3/projects/de030295fc2e466ea895232faa0e5497/users/f1711af1df924229bf77cccd2d4fe8c7/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.292479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de030295fc2e466ea895232faa0e5497, user_id=f1711af1df924229bf77cccd2d4fe8c7, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.295159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.308322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1138/2279] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:45 2022] PUT /identity/v3/projects/de030295fc2e466ea895232faa0e5497/users/f1711af1df924229bf77cccd2d4fe8c7/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:45.319650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.319935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.320210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.348112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] MFA Rules not processed for user `f1711af1df924229bf77cccd2d4fe8c7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:45.349362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.411165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1142/2280] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:45.422098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.423859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.495510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4a37-4f90-41b4-a2fc-5caf4ae01ab2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.500922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.502205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.502524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.502829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.511169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.512747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a659b1-d5a7-4cf5-838b-8c375d6bdd08 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.521915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1139/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:45.728641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.801530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13679888-dcf9-4dcd-afe2-13f1cdb8bb04 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:45.807698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:45.808576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.808855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.809133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] PATH_INFO: `/v3/users/f1711af1df924229bf77cccd2d4fe8c7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.810307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1711af1df924229bf77cccd2d4fe8c7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:45.812300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:45.852689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.853080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.853358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.863112 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1711af1df924229bf77cccd2d4fe8c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.871212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:45.872447 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.874444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1711af1df924229bf77cccd2d4fe8c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.875147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1711af1df924229bf77cccd2d4fe8c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.875746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1711af1df924229bf77cccd2d4fe8c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.883888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-32c39627-e292-4bff-884e-b49089b77e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1711af1df924229bf77cccd2d4fe8c7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:45.897212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1143/2282] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:45 2022] DELETE /identity/v3/users/f1711af1df924229bf77cccd2d4fe8c7 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:45.901634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:45.901924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:45.902203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:45.919130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:45.920461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.930438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1140/2283] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:45.946788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.948207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:45.983260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1144/2284] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:45.993598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:45.995017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.018929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59e592-e5a9-4f32-9a0e-5a5f6ce2c7ed None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.050591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d98480b-889e-4823-9206-5fb94fe128e9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.054205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.054879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.055167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.055466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.065468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.067059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.076783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1145/2285] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:46.077399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.078065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.078402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.078743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.134522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.136522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6285dd82-e821-4f53-8e34-e6a09fb4b4ca service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.146138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1141/2286] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:18:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 17 18:18:46.408247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.410606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.428192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dc1ce7-9482-44ea-b19b-22b1fdeff623 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.433806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.434767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.435050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.437437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] PATH_INFO: `/v3/projects/de030295fc2e466ea895232faa0e5497` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.438822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de030295fc2e466ea895232faa0e5497)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.448630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.529252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de030295fc2e466ea895232faa0e5497', 'request_id': 'req-8467a90e-3694-4afb-b69d-8a130f91f54e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.535837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de030295fc2e466ea895232faa0e5497', 'request_id': 'req-8467a90e-3694-4afb-b69d-8a130f91f54e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.543459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de030295fc2e466ea895232faa0e5497', 'request_id': 'req-8467a90e-3694-4afb-b69d-8a130f91f54e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.556553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] The token cache is being invalidate because project de030295fc2e466ea895232faa0e5497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:46.556942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.557770 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8467a90e-3694-4afb-b69d-8a130f91f54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:46.559875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1146/2287] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:46 2022] DELETE /identity/v3/projects/de030295fc2e466ea895232faa0e5497 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:46.568743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.569305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.569305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.606562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:46.607801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.685059 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1142/2288] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:46.693737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.694027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.694302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.716650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:46.718813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:46.734498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1147/2289] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:18:46.735375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.748578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25682ed-e564-4f92-a7ba-18a60d7547d4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.753436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.754106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.754416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.754842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.755576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:46.755886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.757494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.773848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1143/2290] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:18:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:46.775020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.785617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116dea8-8b35-423a-9e91-f0521fa6e923 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.790410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.791117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.791406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.791685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.792392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.794318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.825429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1148/2291] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:46.829795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.840533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adecfc3-ca75-43a2-8e8b-ecd02f672f98 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.901561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.902751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.903247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.903663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.904748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.906702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.933254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1144/2292] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:46 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:46.937132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.948974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2b86cc-c896-4007-afe6-dcb1e7b49637 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.953890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.954560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.954876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.955149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.956250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.957482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:46.975236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1149/2293] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:46.979120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:46.991111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172b39f5-9939-4d31-b46c-9de94938471a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:46.996139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:46.996806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:46.997093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:46.997372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:46.998097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:46.999764 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653767f5-9ae6-461d-9643-a2c8904982cb admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.014197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1145/2294] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:47.018894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.029410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c164650-0b49-4d92-bb9b-7098faf3114c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.035562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.036533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.036906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.037253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] PATH_INFO: `/v3/projects/47f7048108de4ecbb043af9e37b723d8/users/00da3b33562e479db379e7d1f11a2286/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.053274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f7048108de4ecbb043af9e37b723d8, user_id=00da3b33562e479db379e7d1f11a2286, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.056079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.071111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1150/2295] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:47 2022] PUT /identity/v3/projects/47f7048108de4ecbb043af9e37b723d8/users/00da3b33562e479db379e7d1f11a2286/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:47.076312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056ac6-80d3-4d4e-b969-80b3b4215fc3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.076549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056ac6-80d3-4d4e-b969-80b3b4215fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.076819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4056ac6-80d3-4d4e-b969-80b3b4215fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.095507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d4056ac6-80d3-4d4e-b969-80b3b4215fc3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:47.097408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d4056ac6-80d3-4d4e-b969-80b3b4215fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.164640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1146/2296] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:47.175552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:47.177617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:47.266267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc2cec-817a-434c-8b9e-f0b3dcbc9331 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:47.271211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:47.272014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:47.272566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:47.272912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:47.287723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:47.289303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:47.312140 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1151/2297] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:18:48.154223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.155537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.157549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.198882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] MFA Rules not processed for user `00da3b33562e479db379e7d1f11a2286`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:48.201173 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:48.307175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1147/2298] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:48.308495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.322470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308199be-1aa1-4494-b648-afc22bc37d73 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.328381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.329132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.329488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.329838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.331729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.334210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.378289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1152/2299] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/projects => generated 403 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:48.378500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.408525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d4df-6efb-42fa-99d8-70c5e65ac1a5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.481280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.482074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.482365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.482680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.483432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.485799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.514507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1148/2300] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:48 2022] POST /identity/v3/users => generated 308 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:48.515412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.529577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f4911-6007-4fd9-acea-44dc89f46f20 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.534730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.535405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.535690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.535963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.536724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.538618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.552031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1153/2301] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:18:48.556109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.568991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fca8a91-f5cf-41eb-918e-fe1a823c23f8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.574514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.575510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.575798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.576143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] PATH_INFO: `/v3/projects/9742d9242a51485fb1bbea03b47bb5c3/users/f1469e27b4b64fa2a6ff6c38c94c2087/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.598241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9742d9242a51485fb1bbea03b47bb5c3, user_id=f1469e27b4b64fa2a6ff6c38c94c2087, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.601417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.621261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1149/2302] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:48 2022] PUT /identity/v3/projects/9742d9242a51485fb1bbea03b47bb5c3/users/f1469e27b4b64fa2a6ff6c38c94c2087/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:48.625278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.638805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e316cdc-3b5d-407a-b2ba-1fc48e68b3ee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.700465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.701251 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.701600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.701933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.702777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.704449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0dfa961-9a34-479c-9db0-6b73f88bd491 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.716011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1154/2303] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:48.720092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:48.731257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5ad7b-9142-45ad-9427-6024ff78a610 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:48.736429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:48.738007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:48.738281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:48.738549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] PATH_INFO: `/v3/projects/9742d9242a51485fb1bbea03b47bb5c3/users/f1469e27b4b64fa2a6ff6c38c94c2087/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:48.740591 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=9742d9242a51485fb1bbea03b47bb5c3, user_id=f1469e27b4b64fa2a6ff6c38c94c2087, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:48.743430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:48.756634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1150/2304] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:48 2022] PUT /identity/v3/projects/9742d9242a51485fb1bbea03b47bb5c3/users/f1469e27b4b64fa2a6ff6c38c94c2087/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:18:50.048153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:50.048701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:50.049515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:50.085075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] MFA Rules not processed for user `f1469e27b4b64fa2a6ff6c38c94c2087`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:50.086295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:50.176001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1155/2305] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:51.824120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:51.922705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4711a-c384-4952-857f-fd5bfc983eef admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:51.927397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:51.928303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:51.928583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:51.931876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] PATH_INFO: `/v3/users/00da3b33562e479db379e7d1f11a2286` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:51.933425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=00da3b33562e479db379e7d1f11a2286)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:51.935521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:52.001295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00da3b33562e479db379e7d1f11a2286'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.015825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00da3b33562e479db379e7d1f11a2286'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.016594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00da3b33562e479db379e7d1f11a2286'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.026613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00da3b33562e479db379e7d1f11a2286'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.034256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00da3b33562e479db379e7d1f11a2286'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.041492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1151/2306] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:51 2022] DELETE /identity/v3/users/00da3b33562e479db379e7d1f11a2286 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:52.275241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:52.300887 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a664c3c-b209-4f10-9b67-915a2e01e190 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:52.368664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:52.369613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:52.369893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:52.370170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] PATH_INFO: `/v3/projects/47f7048108de4ecbb043af9e37b723d8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:52.371490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f7048108de4ecbb043af9e37b723d8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:52.373583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:52.431074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f7048108de4ecbb043af9e37b723d8', 'request_id': 'req-e10eff01-ab2d-4769-850b-cceff47d29aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.436599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f7048108de4ecbb043af9e37b723d8', 'request_id': 'req-e10eff01-ab2d-4769-850b-cceff47d29aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.449083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f7048108de4ecbb043af9e37b723d8', 'request_id': 'req-e10eff01-ab2d-4769-850b-cceff47d29aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.462873 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] The token cache is being invalidate because project 47f7048108de4ecbb043af9e37b723d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:52.463354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.464179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.465986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1156/2307] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:52 2022] DELETE /identity/v3/projects/47f7048108de4ecbb043af9e37b723d8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:52.470125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:52.472453 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:52.487257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e56d-c2ed-456c-8b1d-20a73841f7dc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:52.555292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:52.556096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:52.556542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:52.558770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] PATH_INFO: `/v3/users/f1469e27b4b64fa2a6ff6c38c94c2087` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:52.558770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1469e27b4b64fa2a6ff6c38c94c2087)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:52.560383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:52.614839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1469e27b4b64fa2a6ff6c38c94c2087'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.628583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1469e27b4b64fa2a6ff6c38c94c2087'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.629427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1469e27b4b64fa2a6ff6c38c94c2087'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.636524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1469e27b4b64fa2a6ff6c38c94c2087'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.645775 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4a87eb35-b9f7-44ec-90af-41143bd5ac6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1469e27b4b64fa2a6ff6c38c94c2087'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:52.654623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1152/2308] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:18:52 2022] DELETE /identity/v3/users/f1469e27b4b64fa2a6ff6c38c94c2087 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:52.844207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:52.845650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:52.859405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10eff01-ab2d-4769-850b-cceff47d29aa admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:52.922530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:52.923433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:52.923720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:52.924048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] PATH_INFO: `/v3/projects/9742d9242a51485fb1bbea03b47bb5c3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:52.925550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9742d9242a51485fb1bbea03b47bb5c3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:52.927499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:52.996595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9742d9242a51485fb1bbea03b47bb5c3', 'request_id': 'req-31cd4224-930a-4ea4-89eb-9b3ab6685863'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:53.010279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9742d9242a51485fb1bbea03b47bb5c3', 'request_id': 'req-31cd4224-930a-4ea4-89eb-9b3ab6685863'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:53.026913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9742d9242a51485fb1bbea03b47bb5c3', 'request_id': 'req-31cd4224-930a-4ea4-89eb-9b3ab6685863'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:53.042337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] The token cache is being invalidate because project 9742d9242a51485fb1bbea03b47bb5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:18:53.047523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:53.049991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-31cd4224-930a-4ea4-89eb-9b3ab6685863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:18:53.052221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1157/2309] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:18:52 2022] DELETE /identity/v3/projects/9742d9242a51485fb1bbea03b47bb5c3 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:53.056930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.057766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.058224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.079292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:53.081975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:53.176578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1153/2310] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:53.181701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.182055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.182415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.203849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:53.205158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:53.218469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1158/2311] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:53.219690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.230626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89570a7d-c6d7-4da6-93db-3a7a523c4852 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.235648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.236343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.237169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.237440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.238164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:18:53.238468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.240100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.257658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1154/2312] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:18:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:18:53.260648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.272291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208559d6-e666-43e9-8738-0a63b21135a9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.277728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.282075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.282559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.283030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.284961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.286903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.318947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1159/2313] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:53.320099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.332176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158bc1a-a949-467c-a580-65db4f680097 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.403513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.404474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.404940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.405379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.406252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.409039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.434127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1155/2314] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:53.441218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.452875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c853d-ed17-4a41-b861-c55c90a889bf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.461257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.462055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.462409 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.462787 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.463592 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.465273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.481634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1160/2315] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:53.482772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.493576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acffa-f390-4786-86b3-07c1f96fea6b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.498766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.499448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.499779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.500072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.500785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.502494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170aee-96b5-4a18-9ea6-4274797c432f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.513131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1156/2316] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:53.518381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.528987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858efa6-21fd-4cb3-b549-11fe45c92d08 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.536507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.537404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.537690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.537968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] PATH_INFO: `/v3/projects/7663aca73e5d4e1faf5a1e2938569704/users/40feb04cd0f147378d18413f3d76f225/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.554195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7663aca73e5d4e1faf5a1e2938569704, user_id=40feb04cd0f147378d18413f3d76f225, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.556975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.578674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1161/2317] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:53 2022] PUT /identity/v3/projects/7663aca73e5d4e1faf5a1e2938569704/users/40feb04cd0f147378d18413f3d76f225/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:53.585359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.585905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.586281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.616025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] MFA Rules not processed for user `40feb04cd0f147378d18413f3d76f225`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:53.617480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:53.695107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1157/2318] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:53.696361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.762081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb7db7e-90d6-4962-aeb7-d02e3a3e1eb9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.767506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.768836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.769120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.769402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.770272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.772245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.800099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1162/2319] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:53.804469 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.816454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43384e5-6b28-4e3f-8b78-4bb8ac9afc84 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.881018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.881810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.882151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.882492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.883274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.885482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.910472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1158/2320] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:18:53 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:18:53.911774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.929026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906046a7-ab80-4767-9ac7-1086002002ac admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.934176 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.934907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.935196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.935461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.936178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:53.937756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:53.954618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1163/2321] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:53.958941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:53.968983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dc290-c8f4-461e-96d2-9f4f608d182a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:53.976790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:53.978354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:53.978563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:53.978976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] PATH_INFO: `/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806/users/2d43865fd94a4b268479e14b68913b61/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:53.999372 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ec3164fa8449cb77df4b71a1e5806, user_id=2d43865fd94a4b268479e14b68913b61, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:54.004056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:54.021197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1159/2322] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:53 2022] PUT /identity/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806/users/2d43865fd94a4b268479e14b68913b61/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:54.025635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:54.035947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf841fa-0d47-41ca-94b5-39f0b4edb095 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:54.104314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:54.105333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:54.105614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:54.105883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:54.106662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:54.108288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6393d96a-d734-424f-8014-a2b36f41c380 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:54.123978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1164/2323] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:18:54.125306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:54.137734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878ece2-1b13-44e6-9269-3a8c34ca0b05 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:54.144335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:54.145227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:54.145517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:54.145795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] PATH_INFO: `/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806/users/2d43865fd94a4b268479e14b68913b61/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:54.148061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f5ec3164fa8449cb77df4b71a1e5806, user_id=2d43865fd94a4b268479e14b68913b61, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:54.150934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:54.162431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1160/2324] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:18:54 2022] PUT /identity/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806/users/2d43865fd94a4b268479e14b68913b61/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:18:54.173196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:54.173513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:54.173798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:54.211204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] MFA Rules not processed for user `2d43865fd94a4b268479e14b68913b61`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:18:54.212068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:54.302994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1165/2325] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:18:54 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:18:54.315993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:54.320034 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:18:54.393446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d5e73-66b6-44ee-8c61-b8f113ca474f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:54.400184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:54.401633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:54.401981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:54.402342 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:54.413292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:54.414876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24bdeb9-9c43-45a0-bce9-070338440751 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:54.426368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1161/2326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:18:54.507761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:18:54.518186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445e699-6c04-42d4-bd73-f35e5ed478fa None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:18:54.523393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:18:54.524399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:18:54.524805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:18:54.525185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:18:54.593859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:18:54.595620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17d5ae9-a1e2-47c1-821a-e0c38cb10af3 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:18:54.606333 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1166/2327] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:18:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:02.261234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.261810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.262064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.264222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1162/2328] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:19:02.271234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5962-6d17-4b1e-a281-2b8331e75431 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.271685 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5962-6d17-4b1e-a281-2b8331e75431 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.271803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e5962-6d17-4b1e-a281-2b8331e75431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.290285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-084e5962-6d17-4b1e-a281-2b8331e75431 None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:02.291526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-084e5962-6d17-4b1e-a281-2b8331e75431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.379473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1167/2329] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:19:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:02.390919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:02.393202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.453421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310e17e-7ad4-4f03-ae21-d9b440c28fae None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:02.458320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:02.459033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.459331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.459598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.470127 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:02.472245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7559648a-d7c3-4ceb-b956-3e10dd43b6d1 service glance] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:02.482891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1163/2330] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:02.548090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.548372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.548679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] PATH_INFO: `/` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.550151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1168/2331] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:19:02.555305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd52b-039b-413f-bfc3-2fc53090480b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.555531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd52b-039b-413f-bfc3-2fc53090480b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.555811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd52b-039b-413f-bfc3-2fc53090480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.575244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-63cdd52b-039b-413f-bfc3-2fc53090480b None None] MFA Rules not processed for user `d4fbd6d1978f41e1af28e18d26395767`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:02.576442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-63cdd52b-039b-413f-bfc3-2fc53090480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.633556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1164/2332] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:19:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:02.646119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:02.647805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.661312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798d11-084f-4d89-b63b-3c11f8b5895f None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:02.665192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:02.665827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.666125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.666415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.674560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:02.675722 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03db65-0c34-42cb-affc-5b9b5e9924a0 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:02.683586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1169/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:02.768496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.768785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.769056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] PATH_INFO: `/` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.770427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1165/2334] 10.222.0.25 () {54 vars in 921 bytes} [Tue May 17 18:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 17 18:19:02.776198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211841-9ce9-4c92-83f8-b3d6b61547ff None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.776481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211841-9ce9-4c92-83f8-b3d6b61547ff None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.776751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5211841-9ce9-4c92-83f8-b3d6b61547ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.795427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d5211841-9ce9-4c92-83f8-b3d6b61547ff None None] MFA Rules not processed for user `1bc19fa7285245d8bdb984da94d502b8`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:02.796597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d5211841-9ce9-4c92-83f8-b3d6b61547ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.806794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1170/2335] 10.222.0.25 () {58 vars in 1018 bytes} [Tue May 17 18:19:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:02.817293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:02.819263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:02.832900 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef55b6-e6e4-45f9-9eae-c7c4f0f1ada9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:02.836529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:02.837195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:02.837480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:02.837754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:02.848425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:02.849840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:02.860353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1166/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:04.438676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea04d8-ce0f-43c1-bb58-a6c90f88b683 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:04.439201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea04d8-ce0f-43c1-bb58-a6c90f88b683 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:04.439201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea04d8-ce0f-43c1-bb58-a6c90f88b683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:04.456898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3bea04d8-ce0f-43c1-bb58-a6c90f88b683 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:04.458063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3bea04d8-ce0f-43c1-bb58-a6c90f88b683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:04.509659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1171/2337] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:19:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:04.522093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:04.523500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:04.589849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dde5f9-8219-4016-a5b1-9b71308f2e8d service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:04.594737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:04.595501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:04.596302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:04.596577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:04.604658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:04.606235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:04.614129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1167/2338] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:19:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:19:23.769353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df336-0591-410b-b228-b315515275e4 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:23.769901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df336-0591-410b-b228-b315515275e4 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:23.769998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442df336-0591-410b-b228-b315515275e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:23.787594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-442df336-0591-410b-b228-b315515275e4 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:23.788777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-442df336-0591-410b-b228-b315515275e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:23.795906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1172/2339] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:19:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:23.818602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:23.828843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e318f6ec-d644-4da5-a7d8-b4f9ccb73dc5 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:23.833965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:23.834631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:23.834922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:23.835206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:23.843280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:23.844950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a03f59-ed35-43aa-b5a4-6a5fe6132ba1 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:23.852882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1168/2340] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:19:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:19:33.080785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442df336-0591-410b-b228-b315515275e4 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:33.140788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442df336-0591-410b-b228-b315515275e4 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:33.145390 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:33.146253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:33.146534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:33.146838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] PATH_INFO: `/v3/users/40feb04cd0f147378d18413f3d76f225` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:33.148011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=40feb04cd0f147378d18413f3d76f225)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:33.149903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:33.193690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40feb04cd0f147378d18413f3d76f225'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.204880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40feb04cd0f147378d18413f3d76f225'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.205689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40feb04cd0f147378d18413f3d76f225'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.206288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40feb04cd0f147378d18413f3d76f225'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.213352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40feb04cd0f147378d18413f3d76f225'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.226103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1173/2341] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:33 2022] DELETE /identity/v3/users/40feb04cd0f147378d18413f3d76f225 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:33.230888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:33.231431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:33.231555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:33.248339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:33.249510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:33.304054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1169/2342] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:33.313660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:33.315181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:33.370024 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ef094-a29a-4a43-8a63-1af5fc5a2d2e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:33.373642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:33.374624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:33.374905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:33.375180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:33.384004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:33.385401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:33.395049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1174/2343] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:33.655613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:33.657027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:33.669221 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0c6fe-769b-4785-86fd-c429b3c53f65 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:33.674426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:33.675331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:33.675607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:33.675880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] PATH_INFO: `/v3/projects/7663aca73e5d4e1faf5a1e2938569704` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:33.677063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7663aca73e5d4e1faf5a1e2938569704)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:33.679037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:33.726802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7663aca73e5d4e1faf5a1e2938569704', 'request_id': 'req-f584d01d-4bf0-4b98-854e-7429675cf8c0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.732849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7663aca73e5d4e1faf5a1e2938569704', 'request_id': 'req-f584d01d-4bf0-4b98-854e-7429675cf8c0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.740126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7663aca73e5d4e1faf5a1e2938569704', 'request_id': 'req-f584d01d-4bf0-4b98-854e-7429675cf8c0'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.752497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] The token cache is being invalidate because project 7663aca73e5d4e1faf5a1e2938569704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:33.752787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.753429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.755015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1170/2344] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:33 2022] DELETE /identity/v3/projects/7663aca73e5d4e1faf5a1e2938569704 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:33.758975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:33.769065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb829f63-ecfe-414b-8ef8-da89cd73ba5d service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:33.824611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:33.825635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:33.825794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:33.826073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] PATH_INFO: `/v3/users/2d43865fd94a4b268479e14b68913b61` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:33.827293 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d43865fd94a4b268479e14b68913b61)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:33.829179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:33.873108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d43865fd94a4b268479e14b68913b61'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.884517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d43865fd94a4b268479e14b68913b61'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.885187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d43865fd94a4b268479e14b68913b61'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.885773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d43865fd94a4b268479e14b68913b61'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.892150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fa2337e6-b961-407b-92a0-5e9cca03e057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d43865fd94a4b268479e14b68913b61'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:33.904593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1175/2345] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:33 2022] DELETE /identity/v3/users/2d43865fd94a4b268479e14b68913b61 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:34.171558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.172988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:34.187928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584d01d-4bf0-4b98-854e-7429675cf8c0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.245572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.246437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.246756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.247036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] PATH_INFO: `/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.248216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f5ec3164fa8449cb77df4b71a1e5806)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.250123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.294367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f5ec3164fa8449cb77df4b71a1e5806', 'request_id': 'req-ba11089d-f0a3-4282-b7f4-f9b174913f0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:34.300470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f5ec3164fa8449cb77df4b71a1e5806', 'request_id': 'req-ba11089d-f0a3-4282-b7f4-f9b174913f0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:34.307097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f5ec3164fa8449cb77df4b71a1e5806', 'request_id': 'req-ba11089d-f0a3-4282-b7f4-f9b174913f0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:34.319070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] The token cache is being invalidate because project 4f5ec3164fa8449cb77df4b71a1e5806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:34.319359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:34.320010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-ba11089d-f0a3-4282-b7f4-f9b174913f0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:34.321568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1171/2346] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:34 2022] DELETE /identity/v3/projects/4f5ec3164fa8449cb77df4b71a1e5806 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:34.326762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.327287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.327396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.346621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:34.347796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:34.405479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1176/2347] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:34.413472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.413760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.414037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.432135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:34.433309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:34.444027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1172/2348] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:34.448027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.457617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167e58b-6497-415a-b9a8-f123ae848e4a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.462422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.463116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.463425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.463648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.464360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:34.464661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.466240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.477702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1177/2349] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:19:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:34.481814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.491937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4538590-600e-417f-b701-cb649e4321f6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.496539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.497187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.497471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.497856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.498556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.500485 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.535332 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1173/2350] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:34.539471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.549985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3765dc5a-5924-4581-a522-5f74095ec608 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.608340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.609022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.609304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.609602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.610304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.613378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.633255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1178/2351] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:34.637437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.648235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aafa3a-3c9e-4058-abf6-72cf722c08fe admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.652798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.653451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.653733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.654001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.654770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.656440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.666753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1174/2352] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:34.670679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.680702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496cff5-3aee-42e3-8376-2c100235421f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.685271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.685927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.686209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.686481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.687237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.689399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cda25-0e63-4bc1-a7fc-6824df49f6b6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.699469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1179/2353] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:34.703432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.713567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0af9ac4-9d15-42d9-8dc8-cbd0912480b5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.718276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.719965 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.720705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.720850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] PATH_INFO: `/v3/projects/3f79c0dbac1b498f83bef4b10dad9435/users/c00eb8fa87b748dd9bab652d889aaa5b/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.735528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f79c0dbac1b498f83bef4b10dad9435, user_id=c00eb8fa87b748dd9bab652d889aaa5b, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.738168 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.750623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1175/2354] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:34 2022] PUT /identity/v3/projects/3f79c0dbac1b498f83bef4b10dad9435/users/c00eb8fa87b748dd9bab652d889aaa5b/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:34.761338 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.761621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.761895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.788133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] MFA Rules not processed for user `c00eb8fa87b748dd9bab652d889aaa5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:34.789349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:34.852439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1180/2355] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:34.857115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.918756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeba44f-95e5-4c03-844f-d44c032288b9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:34.923417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:34.924087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:34.924368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:34.924646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:34.925842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:34.927289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:34.952785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1176/2356] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/projects => generated 401 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:34.957483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:34.967935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d7b3dd-c47a-4da4-912b-1dc6a2bcc9b0 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.022211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.022916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.023198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.023472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.024159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.026066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.045147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1181/2357] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:34 2022] POST /identity/v3/users => generated 307 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:35.049704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.059938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a0fc2-fd22-4a35-9545-90110cdbf039 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.065182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.065844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.066125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.066401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.067149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.069008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.079226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1177/2358] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:35.083539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.093369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754951fd-9275-4bb8-a75b-e7ac661e19db admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.098168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.099145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.099654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.099654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] PATH_INFO: `/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf/users/375d497de701477497731a025e5fc1c6/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.114697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fe4d71e0a840ca9a27cd7dbdf3c9bf, user_id=375d497de701477497731a025e5fc1c6, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.117334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.130263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1182/2359] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:35 2022] PUT /identity/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf/users/375d497de701477497731a025e5fc1c6/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:35.134004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.143858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ab3b0-9d95-4290-85cf-34ad8dc1d93f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.197281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.197947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.198228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.198502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.199244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.200831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d4415-9d68-4885-95d5-a4b6e78d2888 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.210243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1178/2360] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:35.214281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.224432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285bbc6-7fd5-4dd6-ba22-19fb82b9173f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.229009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.229891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.230172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.230445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] PATH_INFO: `/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf/users/375d497de701477497731a025e5fc1c6/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.232449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] RBAC: Authorizing `identity:create_grant(project_id=23fe4d71e0a840ca9a27cd7dbdf3c9bf, user_id=375d497de701477497731a025e5fc1c6, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.235086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.245403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1183/2361] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:35 2022] PUT /identity/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf/users/375d497de701477497731a025e5fc1c6/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:35.256685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.257164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.257261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.282175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] MFA Rules not processed for user `375d497de701477497731a025e5fc1c6`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:35.283441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:35.349067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1179/2362] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:35.359463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.361681 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:35.415228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d9430-cf2c-460a-b048-966ee5b8adee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.418803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.419431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.419707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.419976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.429049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.430479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.439740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1184/2363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:35.513401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:35.515025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:35.526199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98e794-1c89-4235-84c4-79b5ab8a6813 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:35.529776 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:35.530456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:35.530718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:35.531048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:35.586190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:35.587663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370ff19-84a6-43aa-b7f1-480245193777 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:35.597029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1180/2364] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:35 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:39.742530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:39.804093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0817194e-cd69-4a9e-b447-a8eceb342101 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:39.808643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:39.809540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:39.809824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:39.810100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] PATH_INFO: `/v3/users/c00eb8fa87b748dd9bab652d889aaa5b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:39.811309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00eb8fa87b748dd9bab652d889aaa5b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:39.813221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:39.857325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00eb8fa87b748dd9bab652d889aaa5b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:39.869329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00eb8fa87b748dd9bab652d889aaa5b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:39.870004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00eb8fa87b748dd9bab652d889aaa5b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:39.870634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00eb8fa87b748dd9bab652d889aaa5b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:39.878214 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00eb8fa87b748dd9bab652d889aaa5b'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:39.890161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1185/2365] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:39 2022] DELETE /identity/v3/users/c00eb8fa87b748dd9bab652d889aaa5b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:39.895376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:39.895849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:39.895945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:39.912587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:39.913767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:39.971543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1181/2366] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:39.981304 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:39.982692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:40.037629 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47e4ce-4115-4af8-9324-7aae8e8334ae admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:40.041254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:40.041892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:40.042180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:40.042452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:40.051357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:40.052758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:40.061830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1186/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:40.320151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:40.321570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:40.333935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9ec4f-28f5-4de4-8b77-fe7674de12bb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:40.338640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:40.339517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:40.339803 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:40.340078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] PATH_INFO: `/v3/projects/3f79c0dbac1b498f83bef4b10dad9435` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:40.341283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f79c0dbac1b498f83bef4b10dad9435)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:40.343317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:40.389668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f79c0dbac1b498f83bef4b10dad9435', 'request_id': 'req-711ca43b-9ea0-46d4-bb79-1e35568934ca'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.395222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f79c0dbac1b498f83bef4b10dad9435', 'request_id': 'req-711ca43b-9ea0-46d4-bb79-1e35568934ca'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.402167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f79c0dbac1b498f83bef4b10dad9435', 'request_id': 'req-711ca43b-9ea0-46d4-bb79-1e35568934ca'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.413013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] The token cache is being invalidate because project 3f79c0dbac1b498f83bef4b10dad9435 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:40.413295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.413906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.415507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1182/2368] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:40 2022] DELETE /identity/v3/projects/3f79c0dbac1b498f83bef4b10dad9435 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:40.419423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:40.429167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be236625-bca1-4c7b-afd7-5a223192c4e4 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:40.483402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:40.484272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:40.484549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:40.484848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] PATH_INFO: `/v3/users/375d497de701477497731a025e5fc1c6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:40.486799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] RBAC: Authorizing `identity:delete_user(user_id=375d497de701477497731a025e5fc1c6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:40.488694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:40.534143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375d497de701477497731a025e5fc1c6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.546487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375d497de701477497731a025e5fc1c6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.547201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375d497de701477497731a025e5fc1c6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.547809 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375d497de701477497731a025e5fc1c6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.555213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-158d78f7-742c-48da-b84f-c5c4e6e1133a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375d497de701477497731a025e5fc1c6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.567822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1187/2369] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:40 2022] DELETE /identity/v3/users/375d497de701477497731a025e5fc1c6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:40.842277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:40.843756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:40.861320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ca43b-9ea0-46d4-bb79-1e35568934ca admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:40.915901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:40.916795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:40.917076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:40.917348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] PATH_INFO: `/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:40.918550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23fe4d71e0a840ca9a27cd7dbdf3c9bf)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:40.920490 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:40.968385 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23fe4d71e0a840ca9a27cd7dbdf3c9bf', 'request_id': 'req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.974387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23fe4d71e0a840ca9a27cd7dbdf3c9bf', 'request_id': 'req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.981454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23fe4d71e0a840ca9a27cd7dbdf3c9bf', 'request_id': 'req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.992069 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] The token cache is being invalidate because project 23fe4d71e0a840ca9a27cd7dbdf3c9bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:40.992352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.992991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4b4e0056-2051-4741-9b14-1bfa02b6c1b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:40.994566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1183/2370] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:40 2022] DELETE /identity/v3/projects/23fe4d71e0a840ca9a27cd7dbdf3c9bf => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:40.999872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.000331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.000331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.019872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:41.021055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:41.076795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1188/2371] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:41.084772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.085061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.085335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.105692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:41.106986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:41.114753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1184/2372] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:41.118830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.128365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee6269-6378-45f5-9c6d-17df03bdbaba None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.132959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.133608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.133888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.134161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.134920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:41.135232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.136811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.148354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1189/2373] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:41.152631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.162430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ecf92a-e1b6-4621-8dc1-414a85794a37 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.167025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.167673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.167951 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.168222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.168891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.170799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.195581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1185/2374] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:41.199587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.209862 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42409f02-880c-430b-9817-a353996f29d1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.263237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.263821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.264096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.264368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.265038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.267505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.286751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1190/2375] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/users => generated 294 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:41.290699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.300752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866060-23c6-4989-ae08-0fe99b56f728 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.305230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.305879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.306162 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.306433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.307177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.308766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.318921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1186/2376] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:41.322599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.332585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9512e-8ba5-408d-af93-8b77d7dc0787 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.337153 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.337803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.338083 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.338353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.339093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.340658 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db86b5-4a70-4677-9036-99113c930fde admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.351171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1191/2377] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:41.355729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.365856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6aea4c-5491-4b4f-8a19-5c46e6932950 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.370301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.371274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.371556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.371827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] PATH_INFO: `/v3/projects/5cb1d7e93410488fa2518937f111bb46/users/a150c8d7b872447183f0accfd5acded9/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.387250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cb1d7e93410488fa2518937f111bb46, user_id=a150c8d7b872447183f0accfd5acded9, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.389996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.403077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1187/2378] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:41 2022] PUT /identity/v3/projects/5cb1d7e93410488fa2518937f111bb46/users/a150c8d7b872447183f0accfd5acded9/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:41.414246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.414528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.414838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.440521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] MFA Rules not processed for user `a150c8d7b872447183f0accfd5acded9`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:41.441779 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:41.502989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1192/2379] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:41.507642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.567100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fca055-5680-40b4-a51b-60fe2337c43b admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.572257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.572952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.573233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.573503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.574201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.576187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.607444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1188/2380] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:41.608619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.619603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee36dd3-9cb0-4017-9809-52d5dc14b2ab None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.680223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.680913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.681194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.681476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.682165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.684264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.709291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1193/2381] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/users => generated 300 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:41.713361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.724182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e508d-c1ab-4bad-9a0e-208f4263b4dd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.728876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.729545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.729825 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.730097 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.730887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.732483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.744986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1189/2382] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:41.749427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.760451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a90a15-6e0a-43e2-9aac-1f433562cc68 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.765003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.765880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.766159 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.766431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] PATH_INFO: `/v3/projects/70f7b8f583d241a5952dee94726861b7/users/fdb2776be83f4e52bb97df4093d5571e/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.780461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f7b8f583d241a5952dee94726861b7, user_id=fdb2776be83f4e52bb97df4093d5571e, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.783110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.795425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1194/2383] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:41 2022] PUT /identity/v3/projects/70f7b8f583d241a5952dee94726861b7/users/fdb2776be83f4e52bb97df4093d5571e/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:41.800322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.810292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745062-587a-4473-84f2-6b39a103443c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.872991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.873739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.874023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.874297 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.875216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.877846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035ebb41-fdc7-46da-9ade-f43b99e33704 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.888953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1190/2384] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:41.893155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:41.903487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10c0556-1489-4745-a8ef-8511519d46af admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:41.908420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:41.909385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.909634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.909911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] PATH_INFO: `/v3/projects/70f7b8f583d241a5952dee94726861b7/users/fdb2776be83f4e52bb97df4093d5571e/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.911965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70f7b8f583d241a5952dee94726861b7, user_id=fdb2776be83f4e52bb97df4093d5571e, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:41.914644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:41.926073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1195/2385] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:41 2022] PUT /identity/v3/projects/70f7b8f583d241a5952dee94726861b7/users/fdb2776be83f4e52bb97df4093d5571e/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:41.936599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:41.937063 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:41.937184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:41.964316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] MFA Rules not processed for user `fdb2776be83f4e52bb97df4093d5571e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:41.965645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:42.031572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1191/2386] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:42.042602 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:42.044363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:42.101090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129849d-ecfa-4e66-befa-856019a9ac52 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:42.104904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:42.106116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:42.106116 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:42.106528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:42.117198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:42.118653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2bfc3-7c86-4e19-b376-365bb9a93519 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:42.128371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1196/2387] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:42.638129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:42.698792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7a307a-6a3a-49d6-8e3d-f0bfa2078cd9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:42.703282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:42.704146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:42.704422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:42.704690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] PATH_INFO: `/v3/users/a150c8d7b872447183f0accfd5acded9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:42.706686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a150c8d7b872447183f0accfd5acded9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:42.708594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:42.752073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a150c8d7b872447183f0accfd5acded9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:42.764621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a150c8d7b872447183f0accfd5acded9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:42.765346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a150c8d7b872447183f0accfd5acded9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:42.772787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a150c8d7b872447183f0accfd5acded9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:42.779377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a150c8d7b872447183f0accfd5acded9'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:42.786109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1192/2388] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:42 2022] DELETE /identity/v3/users/a150c8d7b872447183f0accfd5acded9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:42.790649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:42.791150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:42.791431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:42.809661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:42.811452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:42.875725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1197/2389] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:42.887521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:42.888772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:42.959038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b867f990-6871-41e3-8438-099d970d6e39 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:42.959038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:42.959038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:42.959038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:42.959899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:42.973908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:42.975441 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:42.985322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1193/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:43.276233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:43.277692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:43.290373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b97fc-024d-4334-af8b-72884b5845e5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:43.296162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:43.297186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:43.297601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:43.297879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] PATH_INFO: `/v3/projects/5cb1d7e93410488fa2518937f111bb46` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:43.299677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cb1d7e93410488fa2518937f111bb46)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:43.303027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:43.353740 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cb1d7e93410488fa2518937f111bb46', 'request_id': 'req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.361428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cb1d7e93410488fa2518937f111bb46', 'request_id': 'req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.370079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cb1d7e93410488fa2518937f111bb46', 'request_id': 'req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.383143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] The token cache is being invalidate because project 5cb1d7e93410488fa2518937f111bb46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:43.383687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.385668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.387530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1198/2391] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:43 2022] DELETE /identity/v3/projects/5cb1d7e93410488fa2518937f111bb46 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:43.391331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:43.402334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac9b741-dfba-486f-812e-c987cc77902e service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:43.467587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:43.468523 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:43.468810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:43.469082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] PATH_INFO: `/v3/users/fdb2776be83f4e52bb97df4093d5571e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:43.470266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdb2776be83f4e52bb97df4093d5571e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:43.472895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:43.516262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdb2776be83f4e52bb97df4093d5571e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.527841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdb2776be83f4e52bb97df4093d5571e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.528543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdb2776be83f4e52bb97df4093d5571e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.535828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdb2776be83f4e52bb97df4093d5571e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.542789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-def0b92c-22f2-43c6-8eb7-04d2d0eda4fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdb2776be83f4e52bb97df4093d5571e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.548433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1194/2392] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:43 2022] DELETE /identity/v3/users/fdb2776be83f4e52bb97df4093d5571e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:43.810716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:43.812376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:43.828310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6eee5-7bd0-4a66-a132-bc98c15c7a6d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:43.896745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:43.897609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:43.897889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:43.898162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] PATH_INFO: `/v3/projects/70f7b8f583d241a5952dee94726861b7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:43.899366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] RBAC: Authorizing `identity:delete_project(project_id=70f7b8f583d241a5952dee94726861b7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:43.901241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:43.949923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70f7b8f583d241a5952dee94726861b7', 'request_id': 'req-799e8875-ee9a-4c11-93fa-f04749564fac'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.955714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70f7b8f583d241a5952dee94726861b7', 'request_id': 'req-799e8875-ee9a-4c11-93fa-f04749564fac'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.963323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70f7b8f583d241a5952dee94726861b7', 'request_id': 'req-799e8875-ee9a-4c11-93fa-f04749564fac'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.975313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] The token cache is being invalidate because project 70f7b8f583d241a5952dee94726861b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:43.975686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.976385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-799e8875-ee9a-4c11-93fa-f04749564fac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:43.978161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1199/2393] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:43 2022] DELETE /identity/v3/projects/70f7b8f583d241a5952dee94726861b7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:43.982977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:43.983464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:43.983680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.001537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:44.003419 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.063597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1195/2394] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:44.072500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.072786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.073060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.091392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:44.092591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.101560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1200/2395] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:44.106003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.116465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a02a04-6fd3-49d8-99ab-83ccee582c7b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.122220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.122220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.122602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.122975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.123815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:44.124236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.126036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.139510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1196/2396] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:44.143597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.153264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83d10a8-3015-49f8-a007-1911bf350f00 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.158225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.159288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.159577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.160029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.160753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.162683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.198604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1201/2397] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:44 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:44.201841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.211975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca545a8f-95b9-4198-a275-aff189bded02 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.267443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.268137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.268414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.268685 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.269355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.271301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.290458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1197/2398] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:44 2022] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:44.294600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.305364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e25f30-8e6b-4372-8a4e-86bf769a894b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.309995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.310680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.310987 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.311261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.311978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.313549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.324449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1202/2399] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:44.328284 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.338111 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337bd6e-62be-4363-9ce8-349ee76be618 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.342777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.343429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.343712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.343986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.344700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.347041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554853aa-1f52-4b65-bfd8-f9797f1d5a1f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.356729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1198/2400] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:44.360811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.371296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96c022-bb17-48b3-a500-55c7658094f2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.376435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.377320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.377599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.377869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] PATH_INFO: `/v3/projects/ad1c62e6dc464667a9a8e6992ac7be93/users/43df7780626145f2b13b03106ad9038a/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.392335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad1c62e6dc464667a9a8e6992ac7be93, user_id=43df7780626145f2b13b03106ad9038a, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.395119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.407660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1203/2401] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:44 2022] PUT /identity/v3/projects/ad1c62e6dc464667a9a8e6992ac7be93/users/43df7780626145f2b13b03106ad9038a/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:44.475586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.475882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.476164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.502693 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] MFA Rules not processed for user `43df7780626145f2b13b03106ad9038a`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:44.503905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.566678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1199/2402] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:44.577744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.579466 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.635628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab4239-d598-4619-a6ae-e093be53d3a5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.639266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.639911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.640195 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.640468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.649198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.650624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c7f30-b7eb-477a-8176-2795d8364bc5 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.660186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1204/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:44.679615 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.739785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8290b-0afb-4114-b84e-c2a2f871f6da None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.744299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.745160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.745437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.745706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] PATH_INFO: `/v3/users/43df7780626145f2b13b03106ad9038a` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.746911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43df7780626145f2b13b03106ad9038a)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.748836 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:44.796582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43df7780626145f2b13b03106ad9038a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:44.808228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43df7780626145f2b13b03106ad9038a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:44.808917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43df7780626145f2b13b03106ad9038a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:44.816170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43df7780626145f2b13b03106ad9038a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:44.823722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43df7780626145f2b13b03106ad9038a'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:44.829634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1200/2404] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:44 2022] DELETE /identity/v3/users/43df7780626145f2b13b03106ad9038a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:44.835452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.835738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.836009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.854142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:44.855631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.912801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1205/2405] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:44.922442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:44.923999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:44.980725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8000-ea13-45f8-8213-d13869c345a5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:44.984333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:44.984975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:44.985251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:44.985518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:44.994265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:44.995982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9010228-58d1-47ea-a41d-f235809d97c4 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.005245 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1201/2406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:45.269445 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.271044 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:45.294055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898fbe28-5e06-4261-a63b-205c9862b36c None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.299289 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.300231 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.300714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.301060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] PATH_INFO: `/v3/projects/ad1c62e6dc464667a9a8e6992ac7be93` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.302327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad1c62e6dc464667a9a8e6992ac7be93)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.304330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.354307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad1c62e6dc464667a9a8e6992ac7be93', 'request_id': 'req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:45.359733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad1c62e6dc464667a9a8e6992ac7be93', 'request_id': 'req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:45.367530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad1c62e6dc464667a9a8e6992ac7be93', 'request_id': 'req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:45.378798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] The token cache is being invalidate because project ad1c62e6dc464667a9a8e6992ac7be93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:45.379074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:45.379711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b18383ae-5cf0-492c-83ef-0b38f26e2fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:45.381238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1206/2407] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:45 2022] DELETE /identity/v3/projects/ad1c62e6dc464667a9a8e6992ac7be93 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:45.386537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.386851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.387126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.404962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:45.406135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:45.462789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1202/2408] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:45.470308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.470630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.470929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.489570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:45.490807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:45.499004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1207/2409] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:45.503789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.513087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c927c6-edb1-4aa3-8748-6f70647b6e88 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.517703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.518467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.518747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.519028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.519751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:45.520058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.521650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.534828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1203/2410] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:45.539911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.549532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fa550-9bf1-45ce-9c30-f463b7bc43a3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.554385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.555147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.555457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.555754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.556437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.558321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.583677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1208/2411] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:45 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:45.587901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.597532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f2e24-42a8-4562-9f58-71c8d14ef750 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.652366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.653035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.653321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.653855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.654720 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.656648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.676352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1204/2412] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:45 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:45.680595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.691204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b030532d-b109-4ae8-9589-501c40c74809 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.695956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.697151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.697434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.697710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.698410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.700630 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.710782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1209/2413] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:45.714735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.724476 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8e6f58-3971-4758-a531-3c26f45379f9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.729079 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.729731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.730015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.730294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.731042 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.732642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4a51f0-765a-4c40-bdf1-8d3b37400650 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.743551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1205/2414] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:45.747809 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.758665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8eac5f-b62e-4e74-9fb7-49b3e274096f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.776269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.777211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.777547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.777826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] PATH_INFO: `/v3/projects/bc511689b39f491fad65a183059c8bca/users/5fe51ffce217482aa35ce843fc2b172e/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.794487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc511689b39f491fad65a183059c8bca, user_id=5fe51ffce217482aa35ce843fc2b172e, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.797200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:45.810667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1210/2415] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:45 2022] PUT /identity/v3/projects/bc511689b39f491fad65a183059c8bca/users/5fe51ffce217482aa35ce843fc2b172e/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:19:45.821539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.821824 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.822100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.849262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] MFA Rules not processed for user `5fe51ffce217482aa35ce843fc2b172e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:45.850521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:45.914479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1206/2416] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:45.925164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:45.927883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:45.984663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624329a-1cbf-412e-956c-72da9d90824d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:45.988786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:45.989516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:45.989798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:45.990072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:45.998470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:45.999916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:46.009330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1211/2417] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:53.188044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:53.189418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:53.245338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b61396-d7b5-4f5f-b050-b2eec65180c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:53.248876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:53.249540 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:53.249805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:53.250081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:53.251812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:53.312905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:53.314336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b205d-8929-4b5f-8884-c9a57c054abf service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:53.324253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1207/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:56.062026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:56.073429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989cc537-a0f6-4900-8df0-445265d7df8e service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:56.077984 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:56.078927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.079194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.079465 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] PATH_INFO: `/v3/users/5fe51ffce217482aa35ce843fc2b172e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.080647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fe51ffce217482aa35ce843fc2b172e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:56.082746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:56.144118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fe51ffce217482aa35ce843fc2b172e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.156606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fe51ffce217482aa35ce843fc2b172e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.157686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fe51ffce217482aa35ce843fc2b172e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.158321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fe51ffce217482aa35ce843fc2b172e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.165946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fe51ffce217482aa35ce843fc2b172e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.179145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1212/2419] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:56 2022] DELETE /identity/v3/users/5fe51ffce217482aa35ce843fc2b172e => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:56.184012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.184503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.184601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.203318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:56.204507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:56.268126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1208/2420] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:56.277413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:56.277413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:56.355019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fe4a94-c6cf-46ba-b148-f392160baf5e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:56.359446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:56.360254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.360541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.360818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.383228 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:56.384737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:56.396395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1213/2421] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:56.435512 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:56.446766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e754d-3124-46bb-88bb-357a1acaf76e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:56.452328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:56.453053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.453289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.453562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.457010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:56.483186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:56.485159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:56.498652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1209/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:56.589256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:56.591161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:56.609230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a746833-32b4-4935-b2fc-12661baa8de9 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:56.616163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:56.617181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.617612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.617896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] PATH_INFO: `/v3/users/c7b641ce301a4b7685f0f70d7ac4a5d3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.619130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b641ce301a4b7685f0f70d7ac4a5d3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:56.621045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:56.684817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b641ce301a4b7685f0f70d7ac4a5d3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.699589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b641ce301a4b7685f0f70d7ac4a5d3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.700477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b641ce301a4b7685f0f70d7ac4a5d3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.701150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b641ce301a4b7685f0f70d7ac4a5d3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.710483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b641ce301a4b7685f0f70d7ac4a5d3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.734312 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1214/2423] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:56 2022] DELETE /identity/v3/users/c7b641ce301a4b7685f0f70d7ac4a5d3 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:56.817094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:56.818937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:56.833299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b68356-6562-478c-9f50-13c376fc9c43 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:56.900070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:56.900941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:56.901222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:56.901498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] PATH_INFO: `/v3/projects/bc511689b39f491fad65a183059c8bca` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:56.902730 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc511689b39f491fad65a183059c8bca)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:56.904648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:56.952855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc511689b39f491fad65a183059c8bca', 'request_id': 'req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.958958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc511689b39f491fad65a183059c8bca', 'request_id': 'req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.968516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc511689b39f491fad65a183059c8bca', 'request_id': 'req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.981331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] The token cache is being invalidate because project bc511689b39f491fad65a183059c8bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:56.981624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.982283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c43d4a30-3ed4-40d8-b8b7-bd5b0ea5241c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:56.984031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1210/2424] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:56 2022] DELETE /identity/v3/projects/bc511689b39f491fad65a183059c8bca => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:57.160185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.161841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:57.180691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fdee35-fc08-49f0-928a-c93c91c3bbdb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.260848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.261747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.262034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.262309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] PATH_INFO: `/v3/projects/4475ac01e59d43438b45bc5fc01fb00b` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.263515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4475ac01e59d43438b45bc5fc01fb00b)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.265441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.312541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4475ac01e59d43438b45bc5fc01fb00b', 'request_id': 'req-cb3a2024-b2aa-42c2-8e01-499e81aec56e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:57.318518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4475ac01e59d43438b45bc5fc01fb00b', 'request_id': 'req-cb3a2024-b2aa-42c2-8e01-499e81aec56e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:57.326261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4475ac01e59d43438b45bc5fc01fb00b', 'request_id': 'req-cb3a2024-b2aa-42c2-8e01-499e81aec56e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:57.338152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] The token cache is being invalidate because project 4475ac01e59d43438b45bc5fc01fb00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:57.338440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:57.339128 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-cb3a2024-b2aa-42c2-8e01-499e81aec56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:57.340689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1215/2425] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:57 2022] DELETE /identity/v3/projects/4475ac01e59d43438b45bc5fc01fb00b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:57.345797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.346315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.347192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.367200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:57.368487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:57.429234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1211/2426] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:57.437283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.437561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.437832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.457765 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:57.459020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:57.467040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1216/2427] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:57.471459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.482177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded797ba-4e38-4990-b7fb-0f7facfe7355 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.486918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.487842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.488241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.488521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.489430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:19:57.489740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.491401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.503570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1212/2428] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:19:57.508145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.517903 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f59ce7-3799-4c0f-b272-7972d33e9cba None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.523612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.524451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.524732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.525001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.525729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.527701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.557704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1217/2429] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:57.559180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.570107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83fa40-db8b-42e4-b1d0-9a254d0ee35e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.632296 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.632983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.633263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.633541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.634226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.636171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.662543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1213/2430] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:19:57.664113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.674622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ce1be-88d8-4f7a-bc21-a528142a72a2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.681205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.681205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.681205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.681205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.681957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.683572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.698169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1218/2431] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:57.699211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.710420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d234370-bff6-4241-9ac4-a39244c9e739 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.715619 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.716739 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.717499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.717928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.718694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.720300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01669331-3baa-4308-9f7e-afb0db3f75d3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.732427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1214/2432] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:57.736479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.746759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20d3e3-cdd4-494e-945f-ba3f8f8aada3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.751411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.752296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.752576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.752952 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] PATH_INFO: `/v3/projects/e4cc996eb1d946d1a9c12bce1a353944/users/cced486820f44649a8dcb930b624dd59/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.768163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4cc996eb1d946d1a9c12bce1a353944, user_id=cced486820f44649a8dcb930b624dd59, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.771418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:57.785234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1219/2433] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:57 2022] PUT /identity/v3/projects/e4cc996eb1d946d1a9c12bce1a353944/users/cced486820f44649a8dcb930b624dd59/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:57.795167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462580-1c01-4a69-856e-728d532612b4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.795536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462580-1c01-4a69-856e-728d532612b4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.795941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02462580-1c01-4a69-856e-728d532612b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.822873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-02462580-1c01-4a69-856e-728d532612b4 None None] MFA Rules not processed for user `cced486820f44649a8dcb930b624dd59`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:57.824186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-02462580-1c01-4a69-856e-728d532612b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:57.895033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1215/2434] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:57.896782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:57.965652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55213c2e-b275-4044-be43-edb7eaa394d4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:57.970945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:57.971840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:57.972190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:57.972536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:57.973309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:57.975381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.003640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1220/2435] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:19:57 2022] POST /identity/v3/projects => generated 371 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:58.007744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462580-1c01-4a69-856e-728d532612b4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.019953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02462580-1c01-4a69-856e-728d532612b4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.078801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.079634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.079919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.080197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.080998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.083532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.103832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1216/2436] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:19:58 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:19:58.108363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.119518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c1e47-5f22-4bdd-ba2f-bc9aeedaf8f7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.124484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.125155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.125441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.125720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.126441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.128753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.139302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1221/2437] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:19:58.144003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.153921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb5379-0c56-4c70-88d0-983c7145cc11 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.158532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.160548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.160837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.161129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] PATH_INFO: `/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae/users/704915db08fa424d8feb8662dd01e633/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.178393 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2a9591366e47ba8b41b3c83c89f7ae, user_id=704915db08fa424d8feb8662dd01e633, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.181134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.197184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1217/2438] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:58 2022] PUT /identity/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae/users/704915db08fa424d8feb8662dd01e633/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:58.201621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.214810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7e80d-55b3-4e2f-9d49-666e293605b7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.272735 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.273521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.273901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.274277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.275141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.277117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792d3ff-0e0b-4c0b-bd37-9f73ef8efa84 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.289532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1222/2439] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:19:58.293574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.304071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c6a406-f453-4571-9f7d-aa237fccd982 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.311251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.312359 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.312758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.313176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] PATH_INFO: `/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae/users/704915db08fa424d8feb8662dd01e633/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.315262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2a9591366e47ba8b41b3c83c89f7ae, user_id=704915db08fa424d8feb8662dd01e633, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.318424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.329122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1218/2440] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:19:58 2022] PUT /identity/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae/users/704915db08fa424d8feb8662dd01e633/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:58.340985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.341279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.341562 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.382029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] MFA Rules not processed for user `704915db08fa424d8feb8662dd01e633`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:58.383264 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:58.461137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1223/2441] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:58 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:58.470501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:58.473203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:58.556560 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc09b0-28b0-45a2-8f48-1f1cb6a80523 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:58.560581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:58.561420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:58.561998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:58.562466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:58.573210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:58.575420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf692c-1a20-435a-a8cd-22f80c325fec service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:58.587213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1219/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:58 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:59.019215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:59.085086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c2b73-6eab-49c6-9ae8-1a1a52ec9fee None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:59.090290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:59.090872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:59.091156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:59.091431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] PATH_INFO: `/v3/users/cced486820f44649a8dcb930b624dd59` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:59.092619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cced486820f44649a8dcb930b624dd59)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:59.094563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:59.144002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cced486820f44649a8dcb930b624dd59'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.155545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cced486820f44649a8dcb930b624dd59'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.156230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cced486820f44649a8dcb930b624dd59'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.156840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cced486820f44649a8dcb930b624dd59'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.164727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cced486820f44649a8dcb930b624dd59'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.177277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1224/2443] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:59 2022] DELETE /identity/v3/users/cced486820f44649a8dcb930b624dd59 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:59.181767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:59.182227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:59.182634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:59.200583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:19:59.201795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:59.263561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1220/2444] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:19:59.274911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:59.276724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:59.345649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21126e-6f32-47e9-86e8-e2783e85bfcb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:59.349832 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:59.350504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:59.350833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:59.351096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:59.361968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:59.362830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:59.373508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1225/2445] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:19:59.657456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:59.661158 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:19:59.681481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0eae17-e2e0-429c-aa8d-1d69df4d42c2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:59.686851 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:59.688674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:59.688955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:59.689224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] PATH_INFO: `/v3/projects/e4cc996eb1d946d1a9c12bce1a353944` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:59.691051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4cc996eb1d946d1a9c12bce1a353944)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:59.693576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:19:59.768035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4cc996eb1d946d1a9c12bce1a353944', 'request_id': 'req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.790885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4cc996eb1d946d1a9c12bce1a353944', 'request_id': 'req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.804847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4cc996eb1d946d1a9c12bce1a353944', 'request_id': 'req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.820040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] The token cache is being invalidate because project e4cc996eb1d946d1a9c12bce1a353944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:19:59.820856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.821719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:19:59.823783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1221/2446] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:19:59 2022] DELETE /identity/v3/projects/e4cc996eb1d946d1a9c12bce1a353944 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:19:59.827495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:19:59.838252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715ec194-64f9-41c7-8e9f-b4237559b9b9 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:19:59.916066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:19:59.917319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:19:59.917697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:19:59.918063 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] PATH_INFO: `/v3/users/704915db08fa424d8feb8662dd01e633` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:19:59.919654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=704915db08fa424d8feb8662dd01e633)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:19:59.922175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:00.016183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '704915db08fa424d8feb8662dd01e633'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.042719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '704915db08fa424d8feb8662dd01e633'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.043613 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '704915db08fa424d8feb8662dd01e633'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.044357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '704915db08fa424d8feb8662dd01e633'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.071113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '704915db08fa424d8feb8662dd01e633'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.098920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1226/2447] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:19:59 2022] DELETE /identity/v3/users/704915db08fa424d8feb8662dd01e633 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:00.250608 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:00.252581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.275366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea4a17-9747-4942-a4aa-5f24ed4d4c2e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:00.343335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:00.344411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.344707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.344984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] PATH_INFO: `/v3/users/17c2097983df461eb7c23bc0ed7b7520` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.346212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c2097983df461eb7c23bc0ed7b7520)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:00.349117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:00.397630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c2097983df461eb7c23bc0ed7b7520'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.410002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c2097983df461eb7c23bc0ed7b7520'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.410818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c2097983df461eb7c23bc0ed7b7520'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.417426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c2097983df461eb7c23bc0ed7b7520'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.426169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c2097983df461eb7c23bc0ed7b7520'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.436732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1222/2448] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:00 2022] DELETE /identity/v3/users/17c2097983df461eb7c23bc0ed7b7520 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:00.609282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:00.611125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.624684 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02fa52-8a55-4b76-9717-12f99ae9b6e7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:00.681701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:00.682654 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.682938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.683209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] PATH_INFO: `/v3/projects/c087a662f09843faa87b942c9462ec67` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.684510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c087a662f09843faa87b942c9462ec67)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:00.686664 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:00.734834 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c087a662f09843faa87b942c9462ec67', 'request_id': 'req-a37b8fa0-7bf0-41b1-b796-692706a1f49d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.740755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c087a662f09843faa87b942c9462ec67', 'request_id': 'req-a37b8fa0-7bf0-41b1-b796-692706a1f49d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.749850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c087a662f09843faa87b942c9462ec67', 'request_id': 'req-a37b8fa0-7bf0-41b1-b796-692706a1f49d'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.760602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:00.762019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.767473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] The token cache is being invalidate because project c087a662f09843faa87b942c9462ec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:00.767760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.769030 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-a37b8fa0-7bf0-41b1-b796-692706a1f49d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.773924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1227/2449] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:00 2022] DELETE /identity/v3/projects/c087a662f09843faa87b942c9462ec67 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:00.776138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711e79-8260-43b2-8474-b5053a5288e9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.776618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711e79-8260-43b2-8474-b5053a5288e9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.776913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711e79-8260-43b2-8474-b5053a5288e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.778468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7dae0-57d9-41d6-a0bf-2c6b7e361430 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:00.804321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-3a711e79-8260-43b2-8474-b5053a5288e9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:00.805325 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3a711e79-8260-43b2-8474-b5053a5288e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.848910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:00.849868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.850215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.850551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] PATH_INFO: `/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.851915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2a9591366e47ba8b41b3c83c89f7ae)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:00.853924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:00.877513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1228/2450] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:00.887155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.887449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.887750 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.905544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2a9591366e47ba8b41b3c83c89f7ae', 'request_id': 'req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.907210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:00.908424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.911766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2a9591366e47ba8b41b3c83c89f7ae', 'request_id': 'req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.920941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2a9591366e47ba8b41b3c83c89f7ae', 'request_id': 'req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.936706 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] The token cache is being invalidate because project 5b2a9591366e47ba8b41b3c83c89f7ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:00.937043 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.937888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-5e46cc2b-f9fb-4046-99de-7f5dfab58d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:00.939710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1223/2451] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:00 2022] DELETE /identity/v3/projects/5b2a9591366e47ba8b41b3c83c89f7ae => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:00.946067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17f6f-a94c-4bee-98d1-353c2eb9ae7a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.946841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17f6f-a94c-4bee-98d1-353c2eb9ae7a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.947324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e17f6f-a94c-4bee-98d1-353c2eb9ae7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.968310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-05e17f6f-a94c-4bee-98d1-353c2eb9ae7a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:00.969526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-05e17f6f-a94c-4bee-98d1-353c2eb9ae7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:00.974996 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1229/2452] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:00.978336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1224/2453] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:00.979020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:00.985916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.986277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.986648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.989168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989bac7-97b6-4dff-8df4-6513cb4a7748 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:00.993709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:00.994372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:00.994689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:00.994965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:00.995688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:00.996021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:00.997625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.006879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:01.007973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:01.009336 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1230/2454] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:01.013831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.017800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1225/2455] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:01.021771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.024322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58134caf-c53a-4236-9183-b96595baaddd admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.029177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.029837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.030121 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.030396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.031119 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.032443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6482e033-572f-400f-8f62-3fd6b69eadc0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.033011 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.038923 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.039850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.040304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.040733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.041740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:01.042201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.044165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.061227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1226/2456] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:01.062215 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1231/2457] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:01.062438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.066563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.075535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17822c17-4aa8-4f36-9832-469c1316b6fe admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.140831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a51481-d9b4-4760-a3a7-293317997ce2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.154665 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.155353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.155680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.155908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.156595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.158973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.166000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.166928 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.167251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.167631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.168426 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.171459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.206811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1232/2458] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/users => generated 291 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:01.212055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.236291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb2b2c-dc30-42bc-ac61-498ef1a45f49 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.246225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.247460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.247956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.248440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.249393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.251282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.266556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1227/2459] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/projects => generated 369 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:01.266941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1233/2460] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:01.271581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.271785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.283474 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427930c-9fd5-48a6-a112-0a12d869758b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.355885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.356560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.356838 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.357110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.357829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.359449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.373842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1234/2461] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:01.374994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.385617 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e2b1ec-680c-4064-8b26-441f193c2b91 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.385831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a46d460-b3c1-487c-822d-1977a303a578 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.391169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.391638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.392174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.392344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.392499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.392611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] PATH_INFO: `/v3/projects/de657964728b4f5c9801614e1ccb2ed0/users/72eddd1e03d64064b50b97cbc10ba2cb/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.392790 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.393104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.393816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.397594 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.409990 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de657964728b4f5c9801614e1ccb2ed0, user_id=72eddd1e03d64064b50b97cbc10ba2cb, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.413043 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baccb38-bf10-4c6d-8d97-97a13217695f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.422027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1228/2462] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/users => generated 285 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:01.426429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.435104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1235/2463] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:01 2022] PUT /identity/v3/projects/de657964728b4f5c9801614e1ccb2ed0/users/72eddd1e03d64064b50b97cbc10ba2cb/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:01.446777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8ff79f-0f9d-4a92-af76-e6f2847a13f0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.446964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.447221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.447493 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.477452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] MFA Rules not processed for user `72eddd1e03d64064b50b97cbc10ba2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:01.478701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:01.511726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.512556 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.513326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.513326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.514312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.515991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.526140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1229/2464] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:01.530070 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.540533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea410d-b74d-4c82-9eb4-d88a16dde719 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.545558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.546234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.546518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.546831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.547587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.549174 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.552950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1236/2465] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:01.557243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.563943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1230/2466] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:01.568404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.569186 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0480ec-5e26-4b7a-b71b-db2510a15b9e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.573736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.574396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.574712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.574989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.575676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.577570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.580083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb71f29-afc1-4fca-b820-0e29c75972a7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.585911 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.586550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.586955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.587509 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] PATH_INFO: `/v3/projects/39110d2d18524d26b80df584b529d8c0/users/fbedc026e298421cb67baf088ae71114/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.603804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1237/2467] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:01.605872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39110d2d18524d26b80df584b529d8c0, user_id=fbedc026e298421cb67baf088ae71114, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.607995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.608909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9645803-4a08-49ab-a6f5-9a9e335befa9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.632459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1231/2468] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:01 2022] PUT /identity/v3/projects/39110d2d18524d26b80df584b529d8c0/users/fbedc026e298421cb67baf088ae71114/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:01.643144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39605d-906c-496e-94e9-069009861d5e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.644045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39605d-906c-496e-94e9-069009861d5e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.644370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39605d-906c-496e-94e9-069009861d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.672821 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-9e39605d-906c-496e-94e9-069009861d5e None None] MFA Rules not processed for user `fbedc026e298421cb67baf088ae71114`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:01.674123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-9e39605d-906c-496e-94e9-069009861d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:01.676319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a93945-3ac0-42c6-a888-161e122be7ff admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.745539 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.746495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.746985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.747427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.748268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.750354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.768348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1232/2469] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:01.773610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39605d-906c-496e-94e9-069009861d5e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.781447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1238/2470] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:01.784783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.792077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39605d-906c-496e-94e9-069009861d5e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.796184 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a27336-d3d6-43a2-b7bb-263091fec03d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.801428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.802369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.802500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.802848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.803448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.803573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.804375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.804375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.804678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.805376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.806139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.806999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.819626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1239/2471] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:01.823805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.835125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db4cc5-0bbb-4d27-9ca6-9256a88c7e1f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.836935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1233/2472] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/projects => generated 367 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:01.840916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.901093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.902061 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.902446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.902819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] PATH_INFO: `/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51/users/cb5e520d4d1b40899de9365a205da0fd/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.907269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f734a-98ab-45da-b5f2-dcb5ba0099c8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:01.912391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:01.913082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:01.913350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:01.913627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:01.914312 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.916337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.918235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4f2b229ed4dc8825abb0d3eb7dd51, user_id=cb5e520d4d1b40899de9365a205da0fd, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:01.921296 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:01.939435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1240/2473] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:01 2022] PUT /identity/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51/users/cb5e520d4d1b40899de9365a205da0fd/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:01.944077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.945581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1234/2474] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:01 2022] POST /identity/v3/users => generated 290 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:01.949427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:01.959906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e3307-4888-4ced-809a-f2c7ac7e3b8a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.020390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.020961 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b7c78-35fe-4122-9316-ac8b3df5af99 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.021266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.021548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.021828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.022552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.024282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.025793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.026462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.026777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.027054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.027776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.029357 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.034471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1235/2475] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:02.038403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.039710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1241/2476] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:01 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:02.043406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.050038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b45f9d-b73d-4777-8296-94b6b1716373 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.054384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597def3-1536-4415-a53d-ca1cf7b0dac7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.059089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.059585 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.059977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.060262 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.060488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.060583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] PATH_INFO: `/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51/users/cb5e520d4d1b40899de9365a205da0fd/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.060774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.061050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] PATH_INFO: `/v3/projects/2061185ed36943b5b4b9419d584f663c/users/e0de11b40c8c4da2b9ff6e10163a09d4/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.062731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ec4f2b229ed4dc8825abb0d3eb7dd51, user_id=cb5e520d4d1b40899de9365a205da0fd, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.066104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e4db67-3b7b-4c7d-944d-5e4f8f3ca39b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.077072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1242/2477] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:02 2022] PUT /identity/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51/users/cb5e520d4d1b40899de9365a205da0fd/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:02.077367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2061185ed36943b5b4b9419d584f663c, user_id=e0de11b40c8c4da2b9ff6e10163a09d4, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.080275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.087362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.087667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.087949 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.094702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1236/2478] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:02 2022] PUT /identity/v3/projects/2061185ed36943b5b4b9419d584f663c/users/e0de11b40c8c4da2b9ff6e10163a09d4/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:02.098694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.118667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] MFA Rules not processed for user `cb5e520d4d1b40899de9365a205da0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:02.119884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:02.171345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb276e3-9a4b-4dc7-b5be-78017f2af20c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.177267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.177877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.178157 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.178430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.179204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.181006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.195865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1237/2479] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:02.196047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1243/2480] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:02.196152 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.203777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.205279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:02.206304 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3594a654-ca5c-4748-801d-e8865da82506 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.211230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.212119 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.212399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.212675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] PATH_INFO: `/v3/projects/2061185ed36943b5b4b9419d584f663c/users/e0de11b40c8c4da2b9ff6e10163a09d4/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.214684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2061185ed36943b5b4b9419d584f663c, user_id=e0de11b40c8c4da2b9ff6e10163a09d4, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.217338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4997919-811d-4e95-87e6-2b29d8701a06 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.228141 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1238/2481] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:02 2022] PUT /identity/v3/projects/2061185ed36943b5b4b9419d584f663c/users/e0de11b40c8c4da2b9ff6e10163a09d4/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:02.239263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.239548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.239820 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.271909 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56693bb-40f1-48e1-8c67-021f887c2ce5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.272137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] MFA Rules not processed for user `e0de11b40c8c4da2b9ff6e10163a09d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:02.273823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:02.327548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.328366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.328653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.328929 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.380929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1239/2482] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:02 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:02.392750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.394228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:02.408094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820bfa8b-9408-4d40-9dbc-9d68faf0c4eb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.412771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.413434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.413716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.414351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.419328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.421905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.425465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.427200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.434826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1244/2483] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:02 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:02.438743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1240/2484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:02.488050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.497446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5ee5a-6004-4d92-905c-46fad03309b8 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.501593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.502868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.508129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.508129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.516015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:02.525411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10555448-f1ea-4e92-81de-b77e08f1e4c8 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:02.529603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:02.533294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:02.533294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:02.533294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:02.596283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.598636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.608136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1245/2485] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:02.614753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:02.616179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:02.625749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1241/2486] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:05.669657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:05.671040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:05.728897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c10997-8d25-48bf-8beb-2754489892e2 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:05.732570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:05.733220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:05.733499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:05.733769 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:05.735531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:05.805893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:05.807370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89f3060-383f-4a5f-8762-24276b67bf80 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:05.817692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1246/2487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:05.901520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:05.913381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65c4c0-95fa-4ffd-9b98-fd764502d4b5 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:05.917888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:05.918826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:05.922969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:05.922969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] PATH_INFO: `/v3/users/fbedc026e298421cb67baf088ae71114` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:05.922969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbedc026e298421cb67baf088ae71114)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:05.922969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:05.973779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbedc026e298421cb67baf088ae71114'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:05.985202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbedc026e298421cb67baf088ae71114'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:05.985896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbedc026e298421cb67baf088ae71114'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:05.992942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbedc026e298421cb67baf088ae71114'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.002528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbedc026e298421cb67baf088ae71114'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.009159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1242/2488] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:05 2022] DELETE /identity/v3/users/fbedc026e298421cb67baf088ae71114 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:06.013690 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:06.014019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:06.014300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:06.032122 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:06.033653 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:06.094315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1247/2489] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:06.104694 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:06.106275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:06.163841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f03090-469d-4e07-aec5-0c75ac2e414c admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:06.167735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:06.168382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:06.168660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:06.168930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:06.179037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:06.180463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:06.190525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1243/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:06.593595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:06.595131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:06.607732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ccee7-e2a0-4976-8684-ac2530d8655e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:06.613768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:06.614688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:06.614969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:06.615240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] PATH_INFO: `/v3/projects/39110d2d18524d26b80df584b529d8c0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:06.616439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39110d2d18524d26b80df584b529d8c0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:06.618362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:06.666386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39110d2d18524d26b80df584b529d8c0', 'request_id': 'req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.671646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39110d2d18524d26b80df584b529d8c0', 'request_id': 'req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.679047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39110d2d18524d26b80df584b529d8c0', 'request_id': 'req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.691696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] The token cache is being invalidate because project 39110d2d18524d26b80df584b529d8c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:06.692062 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.692955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.694635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1248/2491] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:06 2022] DELETE /identity/v3/projects/39110d2d18524d26b80df584b529d8c0 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:06.698734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:06.709006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce410cb-28de-4190-aa72-1052a30b8574 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:06.764089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:06.764972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:06.765251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:06.765524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] PATH_INFO: `/v3/users/e0de11b40c8c4da2b9ff6e10163a09d4` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:06.767207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0de11b40c8c4da2b9ff6e10163a09d4)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:06.769159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:06.822251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0de11b40c8c4da2b9ff6e10163a09d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.835052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0de11b40c8c4da2b9ff6e10163a09d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.835864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0de11b40c8c4da2b9ff6e10163a09d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.842769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0de11b40c8c4da2b9ff6e10163a09d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.853337 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-2d1d1956-80bd-4112-bd18-d9743797a839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0de11b40c8c4da2b9ff6e10163a09d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:06.860399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1244/2492] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:06 2022] DELETE /identity/v3/users/e0de11b40c8c4da2b9ff6e10163a09d4 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:07.266097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.267608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:07.283084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693742ef-e1a3-46a3-8f4c-55b7a8f7b87f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.344939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.345727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.346016 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.346287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] PATH_INFO: `/v3/projects/2061185ed36943b5b4b9419d584f663c` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.347843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2061185ed36943b5b4b9419d584f663c)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.349774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.400979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2061185ed36943b5b4b9419d584f663c', 'request_id': 'req-1566da92-d0d5-4425-accf-d1b67dbb2e98'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:07.406638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2061185ed36943b5b4b9419d584f663c', 'request_id': 'req-1566da92-d0d5-4425-accf-d1b67dbb2e98'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:07.415441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2061185ed36943b5b4b9419d584f663c', 'request_id': 'req-1566da92-d0d5-4425-accf-d1b67dbb2e98'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:07.428931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] The token cache is being invalidate because project 2061185ed36943b5b4b9419d584f663c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:07.429223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:07.429890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1566da92-d0d5-4425-accf-d1b67dbb2e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:07.431502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1249/2493] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:07 2022] DELETE /identity/v3/projects/2061185ed36943b5b4b9419d584f663c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:07.438558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.439098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.439545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.462374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:07.463715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:07.524849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1245/2494] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:07.532767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.533058 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.533334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.553173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:07.554395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:07.562835 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1250/2495] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:07.566964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.576844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb99c239-890c-4657-a420-ded51b035e96 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.581632 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.582381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.582692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.582966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.583678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:07.583981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.585576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.601489 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1246/2496] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:07.604456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.633896 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278e7556-fba3-4ee3-ba5e-a5a8bc189cde None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.640975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.641670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.641958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.642240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.643097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.645708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.672764 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1251/2497] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:07 2022] POST /identity/v3/projects => generated 409 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:07.677086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.693770 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42345c2-a8ec-4e0d-995b-18deff1a8093 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.757128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.757986 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.758273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.758623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.759316 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.761232 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.782186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1247/2498] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:07 2022] POST /identity/v3/users => generated 305 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:07.786582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.796716 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a16cef-e43c-4ff9-91ed-fbf16e2bbbee admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.802218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.803536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.803816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.804089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.805340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.806992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.818514 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1252/2499] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:07.822270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.834347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625d89f8-f59d-4aa5-9904-6f84bfd9fd30 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.840003 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.840678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.840961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.841234 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.842812 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.844428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad0c40-ada9-4b5a-a3ae-b6f6d61abc01 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.855513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1248/2500] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:07.859081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:07.869210 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edcbcb-10ed-477c-8a78-463e6c85fbf1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:07.874515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:07.875515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.875864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.876209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] PATH_INFO: `/v3/projects/756118e006ce4dd394609c45e1f40436/users/ff87a18cbd6a4f2fa41fdf350a4df66b/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.894947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=756118e006ce4dd394609c45e1f40436, user_id=ff87a18cbd6a4f2fa41fdf350a4df66b, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:07.898276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:07.911542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1253/2501] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:07 2022] PUT /identity/v3/projects/756118e006ce4dd394609c45e1f40436/users/ff87a18cbd6a4f2fa41fdf350a4df66b/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:07.927077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:07.927302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:07.928209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:07.962083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] MFA Rules not processed for user `ff87a18cbd6a4f2fa41fdf350a4df66b`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:07.963354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:08.033387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1249/2502] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:07 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:08.038180 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.101360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eaf93-cf8b-46f6-a971-2f9c846f3c64 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.107269 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.108352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.109126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.109600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.110500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.113924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.147439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1254/2503] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:08 2022] POST /identity/v3/projects => generated 409 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:08.149324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.162044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d45f4ca-59fc-4a54-a970-f3b879325c18 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.234278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.235004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.235828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.236266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.237558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.239572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.269118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1250/2504] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:08 2022] POST /identity/v3/users => generated 311 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:08.273459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.284968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a9de0-54b0-4179-92cf-93e586f96ff8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.289380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.290041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.290322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.290617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.291335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.292913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.303894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1255/2505] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:08.308203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.319940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528f244-72a3-4ad6-85e5-1f1ce9efd28a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.324811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.325759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.326212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.326498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] PATH_INFO: `/v3/projects/52f8839710ca409fb00503c4bb3dd474/users/56f3d61100fb4a25bc46a418eb642423/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.344413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f8839710ca409fb00503c4bb3dd474, user_id=56f3d61100fb4a25bc46a418eb642423, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.348326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.363350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1251/2506] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:08 2022] PUT /identity/v3/projects/52f8839710ca409fb00503c4bb3dd474/users/56f3d61100fb4a25bc46a418eb642423/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:08.368054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.379240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a52add-5a26-4ec2-b006-44d3fe06c873 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.441257 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.442074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.442641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.442923 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.443638 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.445229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e50f2-6457-49aa-bd58-30446ff9bbe4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.459830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1256/2507] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:08.461015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.472361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87afb980-cf36-4f8c-a411-b95e863640a3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.480499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.481399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.481698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.482616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] PATH_INFO: `/v3/projects/52f8839710ca409fb00503c4bb3dd474/users/56f3d61100fb4a25bc46a418eb642423/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.484237 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f8839710ca409fb00503c4bb3dd474, user_id=56f3d61100fb4a25bc46a418eb642423, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.487494 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.502794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1252/2508] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:08 2022] PUT /identity/v3/projects/52f8839710ca409fb00503c4bb3dd474/users/56f3d61100fb4a25bc46a418eb642423/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:08.512421 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.512713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.512999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.541053 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] MFA Rules not processed for user `56f3d61100fb4a25bc46a418eb642423`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:08.542246 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:08.627507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1257/2509] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:08 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:08.637924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.640039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:08.724428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e43d1-66cc-4999-b11b-1e52e5a6f841 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.728816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.729547 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.729895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.730397 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:08.745309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:08.746786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:08.769066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1253/2510] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:08.944858 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:08.955327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8bd4ef-346b-43b6-883f-77603349c8e5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:08.960773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:08.961692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:08.962260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:08.962540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.035170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:09.036979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:09.058884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1258/2511] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:08 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:09.308154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:09.310703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:09.422416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6fee4-ad88-4400-bc67-e487a85d564a service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:09.429491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:09.430557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:09.430868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:09.431224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] PATH_INFO: `/v3/users/8ba97b67ecf64476a630fd3667d617fb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.432572 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba97b67ecf64476a630fd3667d617fb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:09.434954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:09.484277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba97b67ecf64476a630fd3667d617fb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.495699 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba97b67ecf64476a630fd3667d617fb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.496368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba97b67ecf64476a630fd3667d617fb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.502909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba97b67ecf64476a630fd3667d617fb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.510012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-799c618f-099c-4914-9809-b29ab2cf9a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba97b67ecf64476a630fd3667d617fb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.515846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1254/2512] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:09 2022] DELETE /identity/v3/users/8ba97b67ecf64476a630fd3667d617fb => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:09.688814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:09.703488 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a399ae44-1de1-45a4-8d62-4f00dcebbba4 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:09.768917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:09.769783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:09.770133 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:09.770661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] PATH_INFO: `/v3/projects/492389142d804ad392267cb4a728008d` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.771917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=492389142d804ad392267cb4a728008d)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:09.773793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:09.819648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492389142d804ad392267cb4a728008d', 'request_id': 'req-079f8365-ae30-4739-8b87-b33a49d21112'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.824816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492389142d804ad392267cb4a728008d', 'request_id': 'req-079f8365-ae30-4739-8b87-b33a49d21112'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.832443 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492389142d804ad392267cb4a728008d', 'request_id': 'req-079f8365-ae30-4739-8b87-b33a49d21112'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.843306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] The token cache is being invalidate because project 492389142d804ad392267cb4a728008d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:09.843591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.844209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-079f8365-ae30-4739-8b87-b33a49d21112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:09.845731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1259/2513] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:09 2022] DELETE /identity/v3/projects/492389142d804ad392267cb4a728008d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:09.850909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:09.851197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:09.851473 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.869214 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:09.870412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:09.933985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1255/2514] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:09.943795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f341-c282-4c15-88c3-ff246796135b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:09.944273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f341-c282-4c15-88c3-ff246796135b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:09.944736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7352f341-c282-4c15-88c3-ff246796135b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.966893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7352f341-c282-4c15-88c3-ff246796135b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:09.968127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7352f341-c282-4c15-88c3-ff246796135b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:09.976397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1260/2515] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:09.980628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:09.992261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f353a25-01ff-4864-880f-b390745a0ae3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:09.997071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:09.997771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:09.998035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:09.998313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:09.999429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:09.999429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.001025 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.017409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1256/2516] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:10.022353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f341-c282-4c15-88c3-ff246796135b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.035156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7352f341-c282-4c15-88c3-ff246796135b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.039794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.040456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.040739 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.041014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.041703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.043631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.078148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1261/2517] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:10.079382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.094797 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6b0b3d-3dc9-470f-a304-9b55d2a80672 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.163513 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.164362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.164652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.164933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.165749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.167714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.193961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1257/2518] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/users => generated 283 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:10.198652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.213241 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f5ca3-ba27-49ed-a353-ec4d4a98bc18 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.222494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.223295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.223634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.224008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.224763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.226352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.238916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1262/2519] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:10.242935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.254846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59c406-0a07-47d4-b4d8-853defcde7ae admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.268016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.268016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.268016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.268016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.268655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.270216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ffd88-b01d-46fb-97ef-d5d7887779d4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.280964 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1258/2520] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:10.289386 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.301626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f40842-153b-437d-a9c3-eb160c1886f4 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.306869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.307762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.308086 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.308306 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] PATH_INFO: `/v3/projects/fc097ca8d02846a9a57a40748342158e/users/5051da51da9b4c8292ac81f9188ba7cb/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.331499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc097ca8d02846a9a57a40748342158e, user_id=5051da51da9b4c8292ac81f9188ba7cb, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.334254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.349745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1263/2521] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:10 2022] PUT /identity/v3/projects/fc097ca8d02846a9a57a40748342158e/users/5051da51da9b4c8292ac81f9188ba7cb/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:10.360538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.360866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.361195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.392734 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] MFA Rules not processed for user `5051da51da9b4c8292ac81f9188ba7cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:10.394081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:10.476108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1259/2522] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:10.481650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.554267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da55571-bfe1-4948-b134-89957900b966 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.560375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.561266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.561551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.561826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.562516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.564506 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.600185 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1264/2523] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:10.601361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.625005 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2464e2-341b-435f-8810-5de051fcb59e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.691215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.691837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.692130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.692668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.693381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.695418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.716769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1260/2524] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:10.720806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.732502 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9530a2f-3003-4e2e-bdd1-e5d22f8e4806 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.738242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.738943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.739227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.739499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.740208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.741791 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.752046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1265/2525] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:10.756183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.769771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cfe28-d778-4fe4-a803-38f533de4e06 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.774552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.775530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.775811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.776087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] PATH_INFO: `/v3/projects/652ad813193b477dac597ff4b8e0af62/users/c677ca9829ca4642bad46ef7ef6aa8fd/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.791228 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652ad813193b477dac597ff4b8e0af62, user_id=c677ca9829ca4642bad46ef7ef6aa8fd, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.793889 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.809370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1261/2526] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:10 2022] PUT /identity/v3/projects/652ad813193b477dac597ff4b8e0af62/users/c677ca9829ca4642bad46ef7ef6aa8fd/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:10.813292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.825132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f42ad-17a0-43c9-8296-2960af93b0af admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.882588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.883438 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.883718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.883997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.884709 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.886280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf009b-aeff-415b-ab6a-d482501e8453 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.896189 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1266/2527] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:10.900486 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:10.911722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7890485-6c9d-4263-a2e2-391fbbe81c18 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:10.916353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:10.917223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.917499 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.917766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] PATH_INFO: `/v3/projects/652ad813193b477dac597ff4b8e0af62/users/c677ca9829ca4642bad46ef7ef6aa8fd/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.919752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=652ad813193b477dac597ff4b8e0af62, user_id=c677ca9829ca4642bad46ef7ef6aa8fd, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:10.922549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:10.934292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1262/2528] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:10 2022] PUT /identity/v3/projects/652ad813193b477dac597ff4b8e0af62/users/c677ca9829ca4642bad46ef7ef6aa8fd/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:10.944935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:10.945190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:10.945471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:10.972617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] MFA Rules not processed for user `c677ca9829ca4642bad46ef7ef6aa8fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:10.973810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.038800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1267/2529] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:10 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:11.050418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:11.052120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.107290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed39f1d-3097-49de-9c16-dde8cb5509d3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:11.110943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:11.111592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.111912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.112331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.121370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:11.122978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:11.132345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1263/2530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:11.524416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:11.572215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:11.573678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.593103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65d1af-cb28-4134-882f-3503063dc2c8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:11.597662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:11.598535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.598843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.599113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] PATH_INFO: `/v3/users/5051da51da9b4c8292ac81f9188ba7cb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.600275 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5051da51da9b4c8292ac81f9188ba7cb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:11.602172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:11.640378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb742ed-5125-4887-94eb-e42fdc9d8c6b service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:11.647367 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:11.648247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.648524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.648808 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] PATH_INFO: `/v3/users/72eddd1e03d64064b50b97cbc10ba2cb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.649194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5051da51da9b4c8292ac81f9188ba7cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.650155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72eddd1e03d64064b50b97cbc10ba2cb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:11.651990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:11.662556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5051da51da9b4c8292ac81f9188ba7cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.663362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5051da51da9b4c8292ac81f9188ba7cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.664596 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5051da51da9b4c8292ac81f9188ba7cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.673095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-9fde8381-e2a0-4cd0-8a91-fc0d89d5d88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5051da51da9b4c8292ac81f9188ba7cb'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.687548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1268/2531] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:11 2022] DELETE /identity/v3/users/5051da51da9b4c8292ac81f9188ba7cb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:11.693187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.693479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.693759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.699295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72eddd1e03d64064b50b97cbc10ba2cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.710956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:11.711203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72eddd1e03d64064b50b97cbc10ba2cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.711960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72eddd1e03d64064b50b97cbc10ba2cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.712079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.718664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72eddd1e03d64064b50b97cbc10ba2cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.725984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc747df0-4a5c-4d03-8296-db99340461f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72eddd1e03d64064b50b97cbc10ba2cb'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:11.731960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1264/2532] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:11 2022] DELETE /identity/v3/users/72eddd1e03d64064b50b97cbc10ba2cb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:11.737255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1403-c956-42cf-8616-356e262b29eb None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.737542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1403-c956-42cf-8616-356e262b29eb None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.737826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c1403-c956-42cf-8616-356e262b29eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.754831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-417c1403-c956-42cf-8616-356e262b29eb None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:11.756028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-417c1403-c956-42cf-8616-356e262b29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.770120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1269/2533] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:11.779790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:11.781168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.815881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1265/2534] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:11.826222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1403-c956-42cf-8616-356e262b29eb None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:11.827588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-417c1403-c956-42cf-8616-356e262b29eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:11.837342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972a35e-bd5b-41d8-9732-9ff986f645d5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:11.883053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c1403-c956-42cf-8616-356e262b29eb None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:11.884256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:11.884911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.885193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.885498 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.886709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:11.887351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:11.887627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:11.887898 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:11.894660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:11.896108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:11.896989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:11.898433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:11.905579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1270/2535] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:11.907996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1266/2536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:12.346831 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.348391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:12.361062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.363421 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:12.374599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1390c7ed-e9a2-482a-bfad-fac66078ed00 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:12.379652 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290fa9d5-103e-4dfc-80d8-7b20df7e8a03 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:12.379904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:12.380844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:12.381056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:12.381330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] PATH_INFO: `/v3/projects/fc097ca8d02846a9a57a40748342158e` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:12.382686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc097ca8d02846a9a57a40748342158e)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:12.384627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:12.385863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:12.386917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:12.388646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:12.389261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] PATH_INFO: `/v3/projects/de657964728b4f5c9801614e1ccb2ed0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:12.390640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=de657964728b4f5c9801614e1ccb2ed0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:12.392659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:12.434284 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc097ca8d02846a9a57a40748342158e', 'request_id': 'req-1d7123b2-4d88-45f4-90a6-8d188dd884a6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.439978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc097ca8d02846a9a57a40748342158e', 'request_id': 'req-1d7123b2-4d88-45f4-90a6-8d188dd884a6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.440947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de657964728b4f5c9801614e1ccb2ed0', 'request_id': 'req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.447060 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de657964728b4f5c9801614e1ccb2ed0', 'request_id': 'req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.449680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc097ca8d02846a9a57a40748342158e', 'request_id': 'req-1d7123b2-4d88-45f4-90a6-8d188dd884a6'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.454622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de657964728b4f5c9801614e1ccb2ed0', 'request_id': 'req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.461618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] The token cache is being invalidate because project fc097ca8d02846a9a57a40748342158e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:12.461902 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.462523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.464384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1271/2537] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/projects/fc097ca8d02846a9a57a40748342158e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:12.467418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] The token cache is being invalidate because project de657964728b4f5c9801614e1ccb2ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:12.467418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.469007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.469137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.469659 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1267/2538] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/projects/de657964728b4f5c9801614e1ccb2ed0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:12.470732 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:12.473806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.475107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:12.535414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7123b2-4d88-45f4-90a6-8d188dd884a6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:12.538088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f6169-c3c0-4767-b6ab-5e26b93add8f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:12.540067 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:12.540942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:12.541226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:12.541509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] PATH_INFO: `/v3/users/c677ca9829ca4642bad46ef7ef6aa8fd` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:12.542655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:12.542783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c677ca9829ca4642bad46ef7ef6aa8fd)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:12.543534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:12.543816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:12.544089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] PATH_INFO: `/v3/users/cb5e520d4d1b40899de9365a205da0fd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:12.544626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:12.545266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb5e520d4d1b40899de9365a205da0fd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:12.547195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:12.590621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c677ca9829ca4642bad46ef7ef6aa8fd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.593669 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb5e520d4d1b40899de9365a205da0fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.602640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c677ca9829ca4642bad46ef7ef6aa8fd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.603339 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c677ca9829ca4642bad46ef7ef6aa8fd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.603958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c677ca9829ca4642bad46ef7ef6aa8fd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.607002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb5e520d4d1b40899de9365a205da0fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.607807 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb5e520d4d1b40899de9365a205da0fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.611523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c677ca9829ca4642bad46ef7ef6aa8fd'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.615605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb5e520d4d1b40899de9365a205da0fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.623087 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb5e520d4d1b40899de9365a205da0fd'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:12.624659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1272/2539] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/users/c677ca9829ca4642bad46ef7ef6aa8fd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:12.629333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1268/2540] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/users/cb5e520d4d1b40899de9365a205da0fd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:12.983299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.984679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:12.990226 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:12.991741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.051766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decc401e-d29d-477e-969d-0bab24ca75e3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.074033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a453bf-a6ca-477d-a05d-0045b201b885 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.078800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.079658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.079938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.080211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] PATH_INFO: `/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.082326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ec4f2b229ed4dc8825abb0d3eb7dd51)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.084277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.108748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.109625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.109933 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.110170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] PATH_INFO: `/v3/projects/652ad813193b477dac597ff4b8e0af62` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.111459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=652ad813193b477dac597ff4b8e0af62)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.113611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.129881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ec4f2b229ed4dc8825abb0d3eb7dd51', 'request_id': 'req-59d615ca-ac69-4908-a0fe-a85277a2219f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.135409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ec4f2b229ed4dc8825abb0d3eb7dd51', 'request_id': 'req-59d615ca-ac69-4908-a0fe-a85277a2219f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.144188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ec4f2b229ed4dc8825abb0d3eb7dd51', 'request_id': 'req-59d615ca-ac69-4908-a0fe-a85277a2219f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.155635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] The token cache is being invalidate because project 8ec4f2b229ed4dc8825abb0d3eb7dd51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:13.155919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.156647 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-59d615ca-ac69-4908-a0fe-a85277a2219f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.158203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1269/2541] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/projects/8ec4f2b229ed4dc8825abb0d3eb7dd51 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:13.161864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '652ad813193b477dac597ff4b8e0af62', 'request_id': 'req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.163118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b77e-1638-43e2-891e-4040a6554e7b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.163437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b77e-1638-43e2-891e-4040a6554e7b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.163672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d301b77e-1638-43e2-891e-4040a6554e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.166843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '652ad813193b477dac597ff4b8e0af62', 'request_id': 'req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.174804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '652ad813193b477dac597ff4b8e0af62', 'request_id': 'req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.181909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d301b77e-1638-43e2-891e-4040a6554e7b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.183124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d301b77e-1638-43e2-891e-4040a6554e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.186132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] The token cache is being invalidate because project 652ad813193b477dac597ff4b8e0af62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:13.186420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.187181 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5a32faa7-37b6-4d2d-abe3-c8fbbdfce5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:13.188701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1273/2542] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:12 2022] DELETE /identity/v3/projects/652ad813193b477dac597ff4b8e0af62 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:13.194844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1a04-9339-46ca-be59-14aabbe82c79 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.195126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1a04-9339-46ca-be59-14aabbe82c79 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.195400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c1a04-9339-46ca-be59-14aabbe82c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.212847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1e8c1a04-9339-46ca-be59-14aabbe82c79 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.214020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1e8c1a04-9339-46ca-be59-14aabbe82c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.242104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1270/2543] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:13.249988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.250279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.250557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.268940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.270124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.272730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1274/2544] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:13.278329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1271/2545] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:13.281590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.281720 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.281957 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.282692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.292052 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537c6c-ba43-49e9-9716-e166243e1e1f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.296640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.297283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.297565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.297837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.298546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:13.298876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.301236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.301456 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.302491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.310583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1275/2546] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:13.314017 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1272/2547] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:13.314734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.319023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.325171 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b0616-5561-4e1b-907e-ebf31f3fbed8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.328347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f81c533-371f-4de0-9247-eba7e5bbd115 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.329881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.330607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.330886 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.331161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.332022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:13.332331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.333294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.333912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.334030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.334185 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.334455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.335175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.337038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.345349 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1276/2548] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:13.349828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.360168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a239d74-c317-4c9c-b3ea-2126217f39b6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.367093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1273/2549] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:13.367245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.367245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.367245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.367245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.367600 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.367975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.369385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.396404 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1277/2550] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:13.400397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.428280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b32e19-e465-4172-b273-3b40304759fd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.461173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac65959d-b709-425b-b5b9-bbfd74f491e8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.465939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.466762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.467040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.467313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.468143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.470247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.487826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.488538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.488822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.489096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.489781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.493917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1278/2551] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:13.494058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.495051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.505570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bd935-ca69-430c-9e90-c8c4456127e0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.510471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.515612 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.515759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1274/2552] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/users => generated 293 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:13.515860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.515860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.515860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.515860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.516643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.524234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1279/2553] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:13.526053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee30812-c569-453c-a953-e32c5f1a1cfa admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.528156 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.531106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.531763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.532041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.532315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.533033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.535176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.537960 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928964-e972-44f7-96c7-f619ba15ac6d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.542473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.543161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.543440 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.543710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.544424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.545118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1275/2554] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:13.546081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.549796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.557396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1280/2555] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:13.560445 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1434051-24db-46ff-a806-6e62247c7d52 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.561479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.565122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.565891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.566181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.566459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.567231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.569074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.571337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11efcbc-ad6d-43cb-9fb6-4b4e248a4518 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.576137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.577003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.577286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.577591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] PATH_INFO: `/v3/projects/852298574fb24c168e574528532a5a96/users/2ad0e86f69dc49d2ac4fb172f37fd87a/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.578698 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1276/2556] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:13.582633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.592187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d62c959-af63-4907-bb2b-2f5d30d410a1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.592599 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852298574fb24c168e574528532a5a96, user_id=2ad0e86f69dc49d2ac4fb172f37fd87a, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.595268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc60350-2ab7-4eb4-a1df-9ed820cb3585 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.597329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.598189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.598477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.598794 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] PATH_INFO: `/v3/projects/a2c1761c050f48d1b64a57f1811b68b1/users/1b20e1c5e98a48a98d7d514fdf8eee39/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.608889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1281/2557] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:13 2022] PUT /identity/v3/projects/852298574fb24c168e574528532a5a96/users/2ad0e86f69dc49d2ac4fb172f37fd87a/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:13.614504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2c1761c050f48d1b64a57f1811b68b1, user_id=1b20e1c5e98a48a98d7d514fdf8eee39, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.617561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1cdb7-1f45-4843-bfca-3dda2bb3dff8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.619993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.620283 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.620560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.630311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1277/2558] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:13 2022] PUT /identity/v3/projects/a2c1761c050f48d1b64a57f1811b68b1/users/1b20e1c5e98a48a98d7d514fdf8eee39/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:13.640058 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.640346 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.640620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.648335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] MFA Rules not processed for user `2ad0e86f69dc49d2ac4fb172f37fd87a`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.649666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.668864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] MFA Rules not processed for user `1b20e1c5e98a48a98d7d514fdf8eee39`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:13.670077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:13.719582 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1282/2559] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:13.724473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.748394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1278/2560] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:13.753290 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.788915 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954e9ed-c336-47f4-9131-76aa277fc743 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.793711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.794373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.794712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.795167 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.795807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.797859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.820299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e99f4-2cd9-42b2-9036-971eb4d204f0 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.824328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1283/2561] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:13.827944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.828610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.828888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.829155 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.829843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.831656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.831918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.863813 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1279/2562] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/projects => generated 387 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:13.865422 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.901041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e016-c6be-4ab1-90b2-665c12aaa192 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.927605 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bc6755-e235-4333-b805-8fd26c160e11 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.932514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.933193 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.933471 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.933772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.934429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.936366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.957630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1280/2563] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:13.961309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.963768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.964431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.964688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.964958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.965726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.967878 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.972904 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff8024-3706-4f40-b6c3-0612eeaf0ab1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:13.977766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:13.978552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:13.978941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:13.979283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:13.980081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:13.981748 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:13.990001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1284/2564] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:13 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:13.993675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:13.993798 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1281/2565] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:13.997719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.007194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c31f8-dcfb-4338-a78e-5f87857787cf admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.008984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab60f2-da26-4886-977c-c3a6b5d95812 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.012453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.013125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.013408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.013682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.014130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.014410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.016107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.016533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.016823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.017100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] PATH_INFO: `/v3/projects/1a092164ef934f2e85794232c7353be6/users/93436db7db8048f781ca07a957245e9f/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.030048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1285/2566] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:14.031308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.033219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a092164ef934f2e85794232c7353be6, user_id=93436db7db8048f781ca07a957245e9f, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.036593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.042688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a433899-7446-46dd-a7eb-fa1bfe972a7f admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.047715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.048372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.048651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.048920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.049719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.050464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1282/2567] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:13 2022] PUT /identity/v3/projects/1a092164ef934f2e85794232c7353be6/users/93436db7db8048f781ca07a957245e9f/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.051583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.054751 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.062280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1286/2568] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:14.066661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.078756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db37e9de-7628-422d-910d-62ea3522b2d0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.125687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e63490-a358-4361-9d0e-0a1f000eabea admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.133831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.134586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.135804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.135804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.136006 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.137752 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.143788 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.144699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.144946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.145491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] PATH_INFO: `/v3/projects/df1836863a85435eb6556f2ed69b2e91/users/22aa47edec46403ea6642c62d95a8a37/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.149227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1283/2569] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:14.153374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.160646 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df1836863a85435eb6556f2ed69b2e91, user_id=22aa47edec46403ea6642c62d95a8a37, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.163402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b7d72f-945a-4fd9-b92c-00fc56dc8ac6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.163549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c211f7-4144-4e85-96ac-468a06562807 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.168146 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.169023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.169324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.169571 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] PATH_INFO: `/v3/projects/1a092164ef934f2e85794232c7353be6/users/93436db7db8048f781ca07a957245e9f/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.171581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a092164ef934f2e85794232c7353be6, user_id=93436db7db8048f781ca07a957245e9f, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.174495 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd118d0-6a0f-4165-9ea5-291201eb9f41 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.176736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1287/2570] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:14 2022] PUT /identity/v3/projects/df1836863a85435eb6556f2ed69b2e91/users/22aa47edec46403ea6642c62d95a8a37/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.184704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1284/2571] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:14 2022] PUT /identity/v3/projects/1a092164ef934f2e85794232c7353be6/users/93436db7db8048f781ca07a957245e9f/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.186548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.187004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.187399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.195717 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.196012 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.196292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.215888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] MFA Rules not processed for user `22aa47edec46403ea6642c62d95a8a37`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:14.217076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.226497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] MFA Rules not processed for user `93436db7db8048f781ca07a957245e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:14.227701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.284392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1288/2572] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:14.288969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.303229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1285/2573] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:14.311191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.312538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.356543 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f17ee73-a807-496b-bb25-9f048865e28d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.361694 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.362439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.362754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.363029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.363714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.365593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.367691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3a2f61-e77f-4a3b-93fa-35b9036fdb0d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.371395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.372033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.372314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.372588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.382599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.384257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.395001 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1289/2574] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:14.395184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1286/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:14.395911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.458782 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.459020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866ee25f-43b0-4509-8d94-5804f42da5bb admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.463686 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.464358 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.464642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.464948 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.465632 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.467585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.469248 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a76f2-2d00-4703-9bc3-843db349979f service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.473819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.474707 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.474989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.475262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] PATH_INFO: `/v3/users/1b20e1c5e98a48a98d7d514fdf8eee39` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.476460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b20e1c5e98a48a98d7d514fdf8eee39)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.478810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.486651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1290/2576] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:14.490890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.500444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef545cd-f940-455b-879f-36d40218ab02 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.506310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.507084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.507371 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.507655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.508583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.510285 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.521197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1291/2577] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:14.525221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.527831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b20e1c5e98a48a98d7d514fdf8eee39'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:14.536614 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63fe0c-b8ba-464c-a1a7-60c62a2e82ec admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.540117 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b20e1c5e98a48a98d7d514fdf8eee39'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:14.540799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b20e1c5e98a48a98d7d514fdf8eee39'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:14.541240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.542104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.542388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.542697 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] PATH_INFO: `/v3/projects/98bf8ab72af642af8a89204e9d989efd/users/e18273b14d2f4979a391a42777b35ae7/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.547446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b20e1c5e98a48a98d7d514fdf8eee39'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:14.556095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d3f64321-81fd-4440-9561-7d25fd128983 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b20e1c5e98a48a98d7d514fdf8eee39'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:14.558510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bf8ab72af642af8a89204e9d989efd, user_id=e18273b14d2f4979a391a42777b35ae7, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.561155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.562139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1287/2578] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:14 2022] DELETE /identity/v3/users/1b20e1c5e98a48a98d7d514fdf8eee39 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.568541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.568953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.569405 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.579485 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1292/2579] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:14 2022] PUT /identity/v3/projects/98bf8ab72af642af8a89204e9d989efd/users/e18273b14d2f4979a391a42777b35ae7/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.585583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.587463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.593015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:14.594166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.651101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafcfbb7-31d2-4805-924c-59c83235bbc9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.653740 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1288/2580] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:14.655746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.656413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.656786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.657065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.657814 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.659661 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.663412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.664896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.672826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1293/2581] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:14.674486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.684280 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2540eb47-08fc-4c40-9580-09d1c053b2f8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.688853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.689760 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.690042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.690315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] PATH_INFO: `/v3/projects/98bf8ab72af642af8a89204e9d989efd/users/e18273b14d2f4979a391a42777b35ae7/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.692552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bf8ab72af642af8a89204e9d989efd, user_id=e18273b14d2f4979a391a42777b35ae7, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.695198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ecf93b-d999-4b22-b808-3a1daf158d1c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.704947 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1294/2582] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:14 2022] PUT /identity/v3/projects/98bf8ab72af642af8a89204e9d989efd/users/e18273b14d2f4979a391a42777b35ae7/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:14.717501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.717786 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.718059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.722726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2722edc7-4bb0-415f-b302-f41b9462722e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.744500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] MFA Rules not processed for user `e18273b14d2f4979a391a42777b35ae7`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:14.745683 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.769763 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.770410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.770724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.770999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.816097 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1295/2583] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:14 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:14.826917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:14.828242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:14.829443 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.831434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.841090 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1289/2584] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:14.886905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa97b331-a544-48fe-95fd-046ae7b17fd2 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:14.890864 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:14.891518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:14.891837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:14.892172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:14.904919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:14.907377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:14.919828 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1296/2585] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:14 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:15.127689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:15.129231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:15.142646 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bfcb39-4c01-4909-a6c8-9d3b6f99bfa7 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:15.161347 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:15.162886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.163179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.163450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] PATH_INFO: `/v3/projects/a2c1761c050f48d1b64a57f1811b68b1` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:15.164985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2c1761c050f48d1b64a57f1811b68b1)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:15.167114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:15.228191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2c1761c050f48d1b64a57f1811b68b1', 'request_id': 'req-db291356-cda2-4bba-b423-e071c9ce1309'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.236147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2c1761c050f48d1b64a57f1811b68b1', 'request_id': 'req-db291356-cda2-4bba-b423-e071c9ce1309'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.245857 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2c1761c050f48d1b64a57f1811b68b1', 'request_id': 'req-db291356-cda2-4bba-b423-e071c9ce1309'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.260112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] The token cache is being invalidate because project a2c1761c050f48d1b64a57f1811b68b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:15.260465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.261598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.263657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1290/2586] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:15 2022] DELETE /identity/v3/projects/a2c1761c050f48d1b64a57f1811b68b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:15.267891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:15.279245 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57011d69-47fc-4f4d-bf72-3fccc0fdf776 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:15.337994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:15.338702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.338956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.339484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] PATH_INFO: `/v3/users/93436db7db8048f781ca07a957245e9f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:15.340679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93436db7db8048f781ca07a957245e9f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:15.342900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:15.391988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93436db7db8048f781ca07a957245e9f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.404199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93436db7db8048f781ca07a957245e9f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.404946 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93436db7db8048f781ca07a957245e9f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.405548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93436db7db8048f781ca07a957245e9f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.413772 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93436db7db8048f781ca07a957245e9f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.427091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1297/2587] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:15 2022] DELETE /identity/v3/users/93436db7db8048f781ca07a957245e9f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:15.452366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:15.454218 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:15.514291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db291356-cda2-4bba-b423-e071c9ce1309 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:15.562958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:15.563621 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.563929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.564208 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:15.566501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:15.631362 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:15.632846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceae59-d417-462f-b656-f79159ad75f3 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:15.641651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1291/2588] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:15.708883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:15.711394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:15.795975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1262627a-5a45-4729-b494-1f02d89a6f46 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:15.801012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:15.801918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.802200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.802476 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] PATH_INFO: `/v3/projects/1a092164ef934f2e85794232c7353be6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:15.803920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a092164ef934f2e85794232c7353be6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:15.806027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:15.854951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a092164ef934f2e85794232c7353be6', 'request_id': 'req-921cd862-25c3-44d2-9ede-e5f8fb4ded14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.860344 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a092164ef934f2e85794232c7353be6', 'request_id': 'req-921cd862-25c3-44d2-9ede-e5f8fb4ded14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.868795 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a092164ef934f2e85794232c7353be6', 'request_id': 'req-921cd862-25c3-44d2-9ede-e5f8fb4ded14'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.883820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] The token cache is being invalidate because project 1a092164ef934f2e85794232c7353be6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:15.884115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.884969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-921cd862-25c3-44d2-9ede-e5f8fb4ded14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:15.886822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1298/2589] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:15 2022] DELETE /identity/v3/projects/1a092164ef934f2e85794232c7353be6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:15.891822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.892112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.892436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:15.910925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:15.912477 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:15.981368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1292/2590] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:15.990781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:15.991124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:15.991406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.009999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:16.011155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.020183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1299/2591] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:16.024376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.033683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badbcf9-4ed5-422c-9152-75ebdba5957f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.038428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.039120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.039399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.039672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.040386 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:16.040688 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.042273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.053980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1293/2592] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:16.058707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.068796 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9f608-d7ab-474f-8a16-cc1b810cca58 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.073381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.074064 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.074343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.074640 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.075331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.077203 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.102714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1300/2593] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:16.108108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.118190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847aa1f-2fdf-4ebf-a748-7464701363be admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.172239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.172960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.173186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.173516 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.174837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.176757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.198655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1294/2594] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:16.201266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.211422 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a78ed62-5952-445d-bc7c-e90c69e22758 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.215977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.216634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.216917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.217193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.217913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.219538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.229459 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1301/2595] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:16.233196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.243381 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117740f-b802-4873-ba79-d5c6c3b19410 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.247943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.248593 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.248873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.249149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.249859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.251468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2c1f9-fe00-4ef8-bcf8-fcebf79268e5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.262451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1295/2596] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:16.266410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.276109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90fb0d-d4fa-4107-844e-2a7b46f57868 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.280728 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.281598 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.281875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.282146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] PATH_INFO: `/v3/projects/a53bffd09a6b4eb3b9b6ba4e341aca56/users/25c1fea0014d46f1981ea33119042b8d/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.296261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53bffd09a6b4eb3b9b6ba4e341aca56, user_id=25c1fea0014d46f1981ea33119042b8d, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.299402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.312897 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1302/2597] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:16 2022] PUT /identity/v3/projects/a53bffd09a6b4eb3b9b6ba4e341aca56/users/25c1fea0014d46f1981ea33119042b8d/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:16.323936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.324227 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.324507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.350094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] MFA Rules not processed for user `25c1fea0014d46f1981ea33119042b8d`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:16.351497 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.420222 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1296/2598] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:16.426057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.459504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.460976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.494558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b2ba6c-d959-442d-b5f1-1bd4660187c3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.501170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.501868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.502875 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.503567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.504267 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.506163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.527207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ff9b7-6d8e-49e0-92a6-48a45878c0ff None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.534978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1303/2599] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:16.535860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.536021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.536787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.537113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.537391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] PATH_INFO: `/v3/users/ff87a18cbd6a4f2fa41fdf350a4df66b` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.538599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff87a18cbd6a4f2fa41fdf350a4df66b)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.540526 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.585906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff87a18cbd6a4f2fa41fdf350a4df66b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:16.597519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ede13-9430-4ff2-97de-26f4c1ee9496 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.598438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff87a18cbd6a4f2fa41fdf350a4df66b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:16.599129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff87a18cbd6a4f2fa41fdf350a4df66b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:16.602265 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.602959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.603253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.603524 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.604207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.605879 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff87a18cbd6a4f2fa41fdf350a4df66b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:16.606104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.613467 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-9849b931-4211-4808-bb5e-802468a3e74a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff87a18cbd6a4f2fa41fdf350a4df66b'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:16.619944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1297/2600] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:16 2022] DELETE /identity/v3/users/ff87a18cbd6a4f2fa41fdf350a4df66b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:16.624364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.624648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.624922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.629017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1304/2601] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:16.630183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.631839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.641313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:16.642470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.643696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6110b-4b9c-4fe1-9dee-9b579a2dbf9a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.699108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.699562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1298/2602] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:16.699807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.700088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.700482 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.701200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.703617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.709634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.711258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.713041 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1305/2603] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:16.717102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.727418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7016786e-3122-4c6e-ac4d-73f51c673a72 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.732256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.733160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.733441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.733715 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] PATH_INFO: `/v3/projects/8ffe456193664f7eb6fafb42e81cb262/users/6c057aabee2c408c9f9b1d6c279bb182/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.748936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffe456193664f7eb6fafb42e81cb262, user_id=6c057aabee2c408c9f9b1d6c279bb182, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.751570 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.764700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1306/2604] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:16 2022] PUT /identity/v3/projects/8ffe456193664f7eb6fafb42e81cb262/users/6c057aabee2c408c9f9b1d6c279bb182/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:16.767710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9b08f-1ce0-42bd-9d22-b30d1934a38f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.768726 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.815542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.816658 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.816937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.817213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.828078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb358dc-6f47-4414-9407-442d8daa6d35 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.833233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.833892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.834169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.834439 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.835178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.836761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.846290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1307/2605] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:16.850457 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:16.859607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1249939e-8df7-435b-87c4-c68468adcab9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:16.864187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:16.865046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.865328 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.865604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] PATH_INFO: `/v3/projects/8ffe456193664f7eb6fafb42e81cb262/users/6c057aabee2c408c9f9b1d6c279bb182/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.867572 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ffe456193664f7eb6fafb42e81cb262, user_id=6c057aabee2c408c9f9b1d6c279bb182, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.870160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee336-57aa-4881-8810-3156bbab17f2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.876559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:16.878940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:16.880687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1308/2606] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:16 2022] PUT /identity/v3/projects/8ffe456193664f7eb6fafb42e81cb262/users/6c057aabee2c408c9f9b1d6c279bb182/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:16.888902 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1299/2607] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:16.890827 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:16.891114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:16.891387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:16.917821 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] MFA Rules not processed for user `6c057aabee2c408c9f9b1d6c279bb182`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:16.919073 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:16.999319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1309/2608] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:16 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:17.171888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:17.173338 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:17.186230 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fafbe-f25b-493b-ab2f-70632504f420 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:17.242627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:17.243501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:17.243785 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:17.244075 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] PATH_INFO: `/v3/projects/756118e006ce4dd394609c45e1f40436` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:17.245295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] RBAC: Authorizing `identity:delete_project(project_id=756118e006ce4dd394609c45e1f40436)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:17.247425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:17.292374 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '756118e006ce4dd394609c45e1f40436', 'request_id': 'req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.298107 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '756118e006ce4dd394609c45e1f40436', 'request_id': 'req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.306350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '756118e006ce4dd394609c45e1f40436', 'request_id': 'req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.318096 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] The token cache is being invalidate because project 756118e006ce4dd394609c45e1f40436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:17.318384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.319048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.320604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1300/2609] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:17 2022] DELETE /identity/v3/projects/756118e006ce4dd394609c45e1f40436 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:17.324575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:17.335226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f4414-ce48-4c1a-94d2-25982dc33ea9 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:17.388954 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:17.389894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:17.390198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:17.390472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] PATH_INFO: `/v3/users/56f3d61100fb4a25bc46a418eb642423` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:17.391776 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56f3d61100fb4a25bc46a418eb642423)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:17.394324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:17.437448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56f3d61100fb4a25bc46a418eb642423'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.449152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56f3d61100fb4a25bc46a418eb642423'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.449801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56f3d61100fb4a25bc46a418eb642423'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.450397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56f3d61100fb4a25bc46a418eb642423'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.458139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-244fc106-8b0f-43b0-aa60-b82df6c38d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56f3d61100fb4a25bc46a418eb642423'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.470510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1310/2610] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:17 2022] DELETE /identity/v3/users/56f3d61100fb4a25bc46a418eb642423 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:17.730702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:17.732134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:17.745859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8611ab33-ecff-4ad8-a0d2-d4e1c94ee119 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:17.801080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:17.802057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:17.802339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:17.802637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] PATH_INFO: `/v3/projects/52f8839710ca409fb00503c4bb3dd474` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:17.803815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f8839710ca409fb00503c4bb3dd474)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:17.805703 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:17.849191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f8839710ca409fb00503c4bb3dd474', 'request_id': 'req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.854252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f8839710ca409fb00503c4bb3dd474', 'request_id': 'req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.861240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f8839710ca409fb00503c4bb3dd474', 'request_id': 'req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.872302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] The token cache is being invalidate because project 52f8839710ca409fb00503c4bb3dd474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:17.872582 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.873197 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-1240e1f9-3781-465f-9cd3-48eb0d7cd7d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:17.874727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1301/2611] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:17 2022] DELETE /identity/v3/projects/52f8839710ca409fb00503c4bb3dd474 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:17.880045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:17.880332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:17.880608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:17.898163 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:17.899365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:17.956965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1311/2612] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:17.964517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:17.964805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:17.965084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:17.982828 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:17.983998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:17.992329 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1302/2613] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:17.996389 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.006297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758fa6f-9a36-4931-8a60-19d524a04b1e None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.011094 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.011767 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.012049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.012321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.013162 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:18.013477 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.015501 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.027160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1312/2614] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:18.031418 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.040903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0486-c8a1-4fc8-9215-b283772a0d30 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.045508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.046151 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.046428 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.046735 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.047415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.049899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.073834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1303/2615] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:18.077771 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.087490 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad13b1bd-1e6b-4a4e-8497-c076adf73997 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.142414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.143077 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.143433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.143706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.144394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.146286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.166666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1313/2616] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:18.171545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.185401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad766d-f9f2-490e-aba2-417ecae6b5b8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.190557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.191260 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.191549 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.191827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.192818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.194410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.206415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1304/2617] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:18.210282 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.220141 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0daf2c-1dac-4933-8ad2-0d2a69de4521 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.225360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.226056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.226346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.226781 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.227509 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.229108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21fc1-1c20-40d6-95ae-ef1fb74bf882 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.244411 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1314/2618] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:18.245674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.255818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28f66-c9aa-4ec5-829a-d0b1646fe705 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.260508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.261459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.261746 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.262018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] PATH_INFO: `/v3/projects/ade8379defa140df93890047862f2e63/users/9beec2b6f8a84833a0cd7a1f10faa15f/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.276100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] RBAC: Authorizing `identity:create_grant(project_id=ade8379defa140df93890047862f2e63, user_id=9beec2b6f8a84833a0cd7a1f10faa15f, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.278760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.293961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1305/2619] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:18 2022] PUT /identity/v3/projects/ade8379defa140df93890047862f2e63/users/9beec2b6f8a84833a0cd7a1f10faa15f/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:18.306003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.306331 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.306693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.333607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] MFA Rules not processed for user `9beec2b6f8a84833a0cd7a1f10faa15f`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:18.334868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:18.403799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1315/2620] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:18.408072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.474538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82a0ad-61ef-4a05-aa52-2862d8defbca admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.479306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.480054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.480331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.480650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.481343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.483317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.509249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1306/2621] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:18.513429 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.524433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba737-bd55-4206-9957-1b1619c66677 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.577711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.578379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.578706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.578986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.579667 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.582232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.602708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1316/2622] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:18.606878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.616882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8574a0-91f9-4efc-af5d-f164cdc3abfc admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.621355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.622024 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.622292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.622565 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.623308 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.624886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.635008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1307/2623] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:18.638888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.649396 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0a3e4-917c-49bc-85aa-beba78e49d19 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.653891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.654800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.655085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.655361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] PATH_INFO: `/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a/users/12ac51cc402e4725a04bd9c7f1546c5f/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.669749 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8289352e0d94c7c983db4fd4d2a9a5a, user_id=12ac51cc402e4725a04bd9c7f1546c5f, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.672403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.684964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1317/2624] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:18 2022] PUT /identity/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a/users/12ac51cc402e4725a04bd9c7f1546c5f/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:18.688800 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.699448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ae3f-d445-48c0-90b8-c98d31e2ef41 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.754219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.754915 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.755201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.755479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.756192 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.757789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b04d801-c9bf-475e-9268-feb5c2adac6d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.767108 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1308/2625] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:18 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:18.771863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.781727 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb122d4-7f3e-4edd-adaa-f59892d9ae31 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.786974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.787850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.788139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.788428 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] PATH_INFO: `/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a/users/12ac51cc402e4725a04bd9c7f1546c5f/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.790393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8289352e0d94c7c983db4fd4d2a9a5a, user_id=12ac51cc402e4725a04bd9c7f1546c5f, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:18.793051 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:18.802921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1318/2626] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:18 2022] PUT /identity/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a/users/12ac51cc402e4725a04bd9c7f1546c5f/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:18.812840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.813134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.813416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:18.840021 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] MFA Rules not processed for user `12ac51cc402e4725a04bd9c7f1546c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:18.841247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:18.905753 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1309/2627] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:18.916758 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:18.918467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:18.973859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb52867-6803-49e3-94ec-310fdbeed0d2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:18.977549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:18.978212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:18.978499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:18.978806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:19.032559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:19.034018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:19.042547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1319/2628] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:19.630689 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:19.632064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:19.644414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0e2c40-4e63-4a0c-b868-7b37b3b6d862 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:19.648396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:19.649188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:19.649451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:19.649787 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:19.652390 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:19.709210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:19.710557 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:19.719333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1310/2629] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:21.726868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:21.728286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:21.771603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:21.779939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc39d702-cff2-4b00-810e-ba0605206956 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:21.784315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:21.785544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:21.785873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:21.786144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:21.787955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:21.798965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0d73b-808a-4d5b-abb2-67926ad808f0 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:21.804956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:21.805840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:21.806120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:21.806768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] PATH_INFO: `/v3/users/2ad0e86f69dc49d2ac4fb172f37fd87a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:21.807860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ad0e86f69dc49d2ac4fb172f37fd87a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:21.809762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:21.854263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:21.856273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276596-32c9-458f-aad0-3ac2e95076df service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:21.859277 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ad0e86f69dc49d2ac4fb172f37fd87a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:21.868241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1311/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:21.872055 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ad0e86f69dc49d2ac4fb172f37fd87a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:21.872860 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ad0e86f69dc49d2ac4fb172f37fd87a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:21.873607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ad0e86f69dc49d2ac4fb172f37fd87a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:21.882266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ad0e86f69dc49d2ac4fb172f37fd87a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:21.896183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1320/2631] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:21 2022] DELETE /identity/v3/users/2ad0e86f69dc49d2ac4fb172f37fd87a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:21.904403 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:21.905365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:21.905365 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:21.922610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:21.923811 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:21.996972 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1312/2632] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:22.009449 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.011556 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:22.095943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9de550b-b6c0-4804-aa45-b5dafdf4e7f9 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.100372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.101192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.101470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.101743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.114456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.116337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.128299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1321/2633] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:22.221537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.223575 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:22.293876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbdea8-a4a8-4bf6-a155-37f80a80a6a6 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.298959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c057aabee2c408c9f9b1d6c279bb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe456193664f7eb6fafb42e81cb262', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.299630 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.299920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.300195 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.301073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:22.301244 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.303431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.314599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1313/2634] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:22.319066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.329534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c008564-db9d-41f9-8053-ca0129291014 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.334587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c057aabee2c408c9f9b1d6c279bb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe456193664f7eb6fafb42e81cb262', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.335301 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.335547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.335824 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.336528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.338542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.364088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1322/2635] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:22 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:22.368663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.379457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e859f0-b2bd-4936-8f63-a12435ed9f76 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.416192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.418198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:22.444715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c057aabee2c408c9f9b1d6c279bb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe456193664f7eb6fafb42e81cb262', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.445391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.446031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.446031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.446727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:22.446996 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.448657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.463177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1314/2636] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:22.484766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a43a9-83b6-4c1a-be53-f0b36824b54d tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.489468 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.490329 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.490631 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.490906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] PATH_INFO: `/v3/projects/852298574fb24c168e574528532a5a96` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.492072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=852298574fb24c168e574528532a5a96)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.493953 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.499809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.510177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78e4ae-64a1-451c-82b8-51ff21401cdc tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.515037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c057aabee2c408c9f9b1d6c279bb182', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ffe456193664f7eb6fafb42e81cb262', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.515871 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.516156 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.516429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] PATH_INFO: `/v3/projects/f18c6ed1642142f7a2e33b862d4b7dca` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.517589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f18c6ed1642142f7a2e33b862d4b7dca)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.520219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.539871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852298574fb24c168e574528532a5a96', 'request_id': 'req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.545508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852298574fb24c168e574528532a5a96', 'request_id': 'req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.553575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852298574fb24c168e574528532a5a96', 'request_id': 'req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.564303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] The token cache is being invalidate because project 852298574fb24c168e574528532a5a96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:22.564591 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.565238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.567810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18c6ed1642142f7a2e33b862d4b7dca', 'request_id': 'req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.568127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1323/2637] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:22 2022] DELETE /identity/v3/projects/852298574fb24c168e574528532a5a96 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:22.571906 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.573299 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:22.575661 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18c6ed1642142f7a2e33b862d4b7dca', 'request_id': 'req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.584319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18c6ed1642142f7a2e33b862d4b7dca', 'request_id': 'req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.596265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] The token cache is being invalidate because project f18c6ed1642142f7a2e33b862d4b7dca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:22.596552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.597249 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.599527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1315/2638] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:22 2022] DELETE /identity/v3/projects/f18c6ed1642142f7a2e33b862d4b7dca => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:22.640435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaefabd-b0d7-48ca-9ef9-f13f55cc7a4e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.698521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.699423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.699705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.700010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] PATH_INFO: `/v3/users/22aa47edec46403ea6642c62d95a8a37` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.701199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22aa47edec46403ea6642c62d95a8a37)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.703107 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.749934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22aa47edec46403ea6642c62d95a8a37'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.761851 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22aa47edec46403ea6642c62d95a8a37'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.762558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22aa47edec46403ea6642c62d95a8a37'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.763249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22aa47edec46403ea6642c62d95a8a37'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.772561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-7b35d1a0-137f-4f92-8c60-259fa0610702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22aa47edec46403ea6642c62d95a8a37'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.786137 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1324/2639] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:22 2022] DELETE /identity/v3/users/22aa47edec46403ea6642c62d95a8a37 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:22.788175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:22.789645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:22.804999 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a822e42-7f17-4cf3-9e32-41e88d80e9d4 tempest-VolumeQuotaClassesTest-82693453 tempest-VolumeQuotaClassesTest-82693453-project-admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:22.865449 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:22.866335 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.866640 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.866912 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] PATH_INFO: `/v3/users/25c1fea0014d46f1981ea33119042b8d` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.868116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c1fea0014d46f1981ea33119042b8d)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:22.870030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:22.914945 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c1fea0014d46f1981ea33119042b8d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.926744 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c1fea0014d46f1981ea33119042b8d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.927586 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c1fea0014d46f1981ea33119042b8d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.939942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c1fea0014d46f1981ea33119042b8d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.947826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c1fea0014d46f1981ea33119042b8d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:22.954231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1316/2640] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:22 2022] DELETE /identity/v3/users/25c1fea0014d46f1981ea33119042b8d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:22.959615 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:22.959930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:22.960182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:22.978054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:22.979291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.039102 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1325/2641] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:23.049521 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.051733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.054437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.056113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.068819 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fca6c-3d59-49e6-a5d0-4eacc27891c8 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.074447 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.075343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.075621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.075890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] PATH_INFO: `/v3/projects/df1836863a85435eb6556f2ed69b2e91` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.077147 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df1836863a85435eb6556f2ed69b2e91)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.079660 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.123834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e22b3-2b73-4b24-89c5-f11aaea7b1ba admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.130748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df1836863a85435eb6556f2ed69b2e91', 'request_id': 'req-10b4d31b-663c-424c-aaea-378552964d91'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.136927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df1836863a85435eb6556f2ed69b2e91', 'request_id': 'req-10b4d31b-663c-424c-aaea-378552964d91'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.145974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df1836863a85435eb6556f2ed69b2e91', 'request_id': 'req-10b4d31b-663c-424c-aaea-378552964d91'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.157708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] The token cache is being invalidate because project df1836863a85435eb6556f2ed69b2e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:23.158004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.159042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.161324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1326/2642] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:23 2022] DELETE /identity/v3/projects/df1836863a85435eb6556f2ed69b2e91 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:23.164938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.166252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.176444 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.177098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.177377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.177650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.179442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.234687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4d31b-663c-424c-aaea-378552964d91 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.239432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.240300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.240586 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.240857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] PATH_INFO: `/v3/users/e18273b14d2f4979a391a42777b35ae7` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.242069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e18273b14d2f4979a391a42777b35ae7)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.243324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.243994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.244962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.256336 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1317/2643] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:23.257150 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.258439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.292158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e18273b14d2f4979a391a42777b35ae7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.306259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e18273b14d2f4979a391a42777b35ae7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.307054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e18273b14d2f4979a391a42777b35ae7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.307699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e18273b14d2f4979a391a42777b35ae7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.315773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e18273b14d2f4979a391a42777b35ae7'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.320584 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a3abb-38ce-44b4-9183-f17a30667af1 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.324583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.325265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.325517 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.325786 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.327750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.333270 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1327/2644] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:23 2022] DELETE /identity/v3/users/e18273b14d2f4979a391a42777b35ae7 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:23.392187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.393639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.404973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1318/2645] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:23.622199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.623919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.711765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.713171 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.736522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ef9868-cb41-4e56-95ee-a41960fae8e2 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.765792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4319d955-850b-4f1f-b8c7-c841d44c942a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.772235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.773109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.773462 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.773652 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] PATH_INFO: `/v3/projects/a53bffd09a6b4eb3b9b6ba4e341aca56` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.775144 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53bffd09a6b4eb3b9b6ba4e341aca56)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.777040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.802502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.803482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.803762 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.804092 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] PATH_INFO: `/v3/projects/98bf8ab72af642af8a89204e9d989efd` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.805839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bf8ab72af642af8a89204e9d989efd)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.808409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:23.827441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53bffd09a6b4eb3b9b6ba4e341aca56', 'request_id': 'req-1bdf438a-b616-48b4-8012-b87377b043f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.834379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53bffd09a6b4eb3b9b6ba4e341aca56', 'request_id': 'req-1bdf438a-b616-48b4-8012-b87377b043f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.842118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53bffd09a6b4eb3b9b6ba4e341aca56', 'request_id': 'req-1bdf438a-b616-48b4-8012-b87377b043f1'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.853362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] The token cache is being invalidate because project a53bffd09a6b4eb3b9b6ba4e341aca56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:23.853645 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.854261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.855848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1328/2646] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:23 2022] DELETE /identity/v3/projects/a53bffd09a6b4eb3b9b6ba4e341aca56 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:23.859539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bf8ab72af642af8a89204e9d989efd', 'request_id': 'req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.860229 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:23.861744 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.866049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bf8ab72af642af8a89204e9d989efd', 'request_id': 'req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.874014 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bf8ab72af642af8a89204e9d989efd', 'request_id': 'req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.885283 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] The token cache is being invalidate because project 98bf8ab72af642af8a89204e9d989efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:23.885704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.886309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a55a71f1-7e28-42e5-9031-6b3871a7fd2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:23.887858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1319/2647] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:23 2022] DELETE /identity/v3/projects/98bf8ab72af642af8a89204e9d989efd => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:23.893546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1796-ecd5-47ac-b006-069b5db2a5f2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.893908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1796-ecd5-47ac-b006-069b5db2a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.894345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f1796-ecd5-47ac-b006-069b5db2a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.913351 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6d7f1796-ecd5-47ac-b006-069b5db2a5f2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:23.914544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6d7f1796-ecd5-47ac-b006-069b5db2a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:23.934924 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdf438a-b616-48b4-8012-b87377b043f1 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:23.975275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1320/2648] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:23.983118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.983408 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.983692 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.989747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:23.990559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:23.990869 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:23.991143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] PATH_INFO: `/v3/users/6c057aabee2c408c9f9b1d6c279bb182` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:23.992327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c057aabee2c408c9f9b1d6c279bb182)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:23.994234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.002153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:24.003410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.012892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1321/2649] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:24.017010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.026545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bf0b5-52fc-4f51-bf1d-8e5e12932413 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.031368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.032015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.032295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.032567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.033276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:24.033581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.035801 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.041549 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c057aabee2c408c9f9b1d6c279bb182'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.047167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1322/2650] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:24.052662 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.054840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c057aabee2c408c9f9b1d6c279bb182'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.055679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c057aabee2c408c9f9b1d6c279bb182'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.056318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c057aabee2c408c9f9b1d6c279bb182'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.062562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2b3023-6710-4e1c-af27-780c2ca737c1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.063320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c057aabee2c408c9f9b1d6c279bb182'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.067599 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.068251 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.068518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.068792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.069527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.071548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.077526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1329/2651] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:23 2022] DELETE /identity/v3/users/6c057aabee2c408c9f9b1d6c279bb182 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:24.100275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1323/2652] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:24.104729 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.106208 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.172040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d61af-bb24-4765-a4a5-924603b6b870 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.227150 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.227723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.228007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.228311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.229478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.230871 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.251554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1330/2653] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:24.255760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.266394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093099bf-b24f-417b-a399-58a70a138c02 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.271952 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.272885 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.273201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.273511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.274250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.275897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.286810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1324/2654] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:24.291095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.302092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0b29a-7ebc-4655-bc7f-d32b170d54d2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.307230 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.307914 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.308179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.308451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.309165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.310792 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.321641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1331/2655] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:24.325809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.336577 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2536d90-35b1-466a-aa0e-fc7c18cc41ed admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.341255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.342186 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.342527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.342994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] PATH_INFO: `/v3/projects/d74d0f9b1d764502bba880c708073a28/users/d04782041e7342bea181514b42ff543f/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.359109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d74d0f9b1d764502bba880c708073a28, user_id=d04782041e7342bea181514b42ff543f, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.361754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b616b-33c8-4b3d-a1c3-dac7032572b4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.365448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.367451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.382657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996e1931-2a38-477a-839b-71d796708dc0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.382865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1325/2656] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:24 2022] PUT /identity/v3/projects/d74d0f9b1d764502bba880c708073a28/users/d04782041e7342bea181514b42ff543f/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:24.395353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.395576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.395845 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.422178 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] MFA Rules not processed for user `d04782041e7342bea181514b42ff543f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:24.423432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.438504 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.439397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.439672 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.439940 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] PATH_INFO: `/v3/projects/8ffe456193664f7eb6fafb42e81cb262` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.441782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ffe456193664f7eb6fafb42e81cb262)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.444109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.486970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1326/2657] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:24.488470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ffe456193664f7eb6fafb42e81cb262', 'request_id': 'req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.492475 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.493817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ffe456193664f7eb6fafb42e81cb262', 'request_id': 'req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.500433 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ffe456193664f7eb6fafb42e81cb262', 'request_id': 'req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.503103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a14c11-f2dd-4d3b-9f12-24fa50c1b28f None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.512471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] The token cache is being invalidate because project 8ffe456193664f7eb6fafb42e81cb262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:24.512748 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.513394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-d80f1a1d-abd3-4be3-bfd9-99b514e1a93e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:24.514964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1332/2658] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:24 2022] DELETE /identity/v3/projects/8ffe456193664f7eb6fafb42e81cb262 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:24.519829 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7057-d1e8-41b0-b7af-47a62f69b357 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.520108 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7057-d1e8-41b0-b7af-47a62f69b357 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.520384 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe7057-d1e8-41b0-b7af-47a62f69b357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.536973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-4bfe7057-d1e8-41b0-b7af-47a62f69b357 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:24.538182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4bfe7057-d1e8-41b0-b7af-47a62f69b357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.558874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.559538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.559852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.560131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.560823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.562759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.588009 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1327/2659] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:24.592013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.593537 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.597813 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1333/2660] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:24.606418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.606751 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.607037 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.625588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:24.626825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.654551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0318df42-6ce9-49cd-af4b-eb2425995e08 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.659256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.660013 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.660294 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.660574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.661285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.663269 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.682897 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1328/2661] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:24.685885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1334/2662] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:24.687529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.689719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.698025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e619347-6ad0-4d67-a541-7d1159826d53 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.700264 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0777b9f2-81b1-4276-8f10-1b11270ed03d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.702855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.703511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.703799 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.704075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.704801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.704900 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.705479 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.705761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.706051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.706395 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.706818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:24.707126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.708701 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.716976 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1335/2663] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:24.724344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1329/2664] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:24.724507 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.725270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.731710 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84bc46-c7dd-4350-b634-0b7eb889dd27 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.734943 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e76515-678a-4aba-ad5c-0573c3487767 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.736403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.737354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.738226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.738823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] PATH_INFO: `/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6/users/68773f8a8e004291aa630b5fccd7117c/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.740451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.741103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.741391 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.741667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.743072 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.744307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.755668 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa10b6ca173b47f28ce4e9162f7123c6, user_id=68773f8a8e004291aa630b5fccd7117c, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.758413 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.772593 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1336/2665] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:24 2022] PUT /identity/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6/users/68773f8a8e004291aa630b5fccd7117c/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:24.778103 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1330/2666] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:24.779253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.779412 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.845454 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd17733-829f-46a8-8974-113802b31546 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.845809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddc918-9ee2-46d6-8ced-42eda88189d7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.852028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.852197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.852750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.852859 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.853049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.853192 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.853273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.853453 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.853994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.854115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.855637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.856028 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.867067 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1331/2667] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:24.871299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.882077 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163003d-1ca4-4b47-8b74-4d72f9a3d4a6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.887286 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.887475 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1337/2668] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:24.888169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.888450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.888722 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] PATH_INFO: `/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6/users/68773f8a8e004291aa630b5fccd7117c/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.890759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa10b6ca173b47f28ce4e9162f7123c6, user_id=68773f8a8e004291aa630b5fccd7117c, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.891175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.893382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93b5dcd-32f8-4fcc-8af7-b428733747dc admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.901846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf83730-163e-4769-91c7-d37e408ed72a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:24.915202 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1332/2669] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:24 2022] PUT /identity/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6/users/68773f8a8e004291aa630b5fccd7117c/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:24.918044 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.918377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.918718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.949363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] MFA Rules not processed for user `68773f8a8e004291aa630b5fccd7117c`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:24.950672 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:24.965973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:24.966724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:24.967008 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:24.967281 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:24.968138 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:24.969893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:24.982666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1338/2670] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:24.987031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:24.998402 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e760a6-6868-47e5-bdaa-420873933f8d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.003904 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.007279 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.007777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.008305 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.009352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.011164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.022252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1339/2671] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:25.026756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.041635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1333/2672] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:25.041841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac962ed0-8978-41ef-87e5-4debe415d2af admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.045075 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.046002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.046286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.046563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] PATH_INFO: `/v3/projects/a961b06c88e84c9bb5233e0f78c8ccf8/users/1c2dc3305a8b4a4595ae4c3958cbd06a/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.049434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.051779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:25.064014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a961b06c88e84c9bb5233e0f78c8ccf8, user_id=1c2dc3305a8b4a4595ae4c3958cbd06a, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.066912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c59fc7-b0fd-4bb4-9152-431de41af264 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.079551 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1340/2673] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:25 2022] PUT /identity/v3/projects/a961b06c88e84c9bb5233e0f78c8ccf8/users/1c2dc3305a8b4a4595ae4c3958cbd06a/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:25.091026 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.091309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.091583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.113402 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3d310-417f-4761-bc4a-256b9156d516 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.120337 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] MFA Rules not processed for user `1c2dc3305a8b4a4595ae4c3958cbd06a`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:25.121565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:25.163601 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.164259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.164538 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.164814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.166876 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:25.193126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1341/2674] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:25.197724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.237984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.239520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.249343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1334/2675] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:25.274335 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf8d27-8b4c-4af2-9c82-5949ad4d1b13 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.279302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.279965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.280247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.280521 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.281200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.283146 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.308659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1342/2676] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:25 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:25.312852 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.324315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eff39e-d75c-4b41-87dc-ff3feaff1362 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.382199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.383064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.383458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.383830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.384712 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.386830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.409182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1335/2677] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:25 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:25.413801 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.425047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c599599-297b-4c8e-acde-fbb8c0f40228 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.429986 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.430689 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.430974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.431247 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.431994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.433584 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.444817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1343/2678] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:25.449756 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.463795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255621b7-0879-4a57-9c39-46f432cd8305 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.469404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.470440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.470844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.471277 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] PATH_INFO: `/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc/users/5b3ae3e5b67b4c70abf99afd8589abb5/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.487170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdb4c66613c40c8b7c56825f06c84cc, user_id=5b3ae3e5b67b4c70abf99afd8589abb5, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.490180 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.504539 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1336/2679] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:25 2022] PUT /identity/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc/users/5b3ae3e5b67b4c70abf99afd8589abb5/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:25.508308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.520424 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34384f94-bbeb-43a7-ac70-cb9bcc2d3ea8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.579956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.580636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.580918 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.581194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.582780 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.584322 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd5228e-ce89-4629-a9e5-01b0fbf87e32 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.594528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1344/2680] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:25.598917 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.608906 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc5eac-3c97-405c-b6e5-75137fd287a7 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.613760 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.614684 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.614969 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.615246 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] PATH_INFO: `/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc/users/5b3ae3e5b67b4c70abf99afd8589abb5/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.617219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdb4c66613c40c8b7c56825f06c84cc, user_id=5b3ae3e5b67b4c70abf99afd8589abb5, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.619934 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.631361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1337/2681] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:25 2022] PUT /identity/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc/users/5b3ae3e5b67b4c70abf99afd8589abb5/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:25.642164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.642456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.642805 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.668731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] MFA Rules not processed for user `5b3ae3e5b67b4c70abf99afd8589abb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:25.669930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:25.735546 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1345/2682] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:25 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:25.747311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.801587 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572f8c8-2cc4-4791-896f-3e41f0a0b9b3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.805204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.805854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.806139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.806415 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.815729 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.817995 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:25.827377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1338/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:25.924205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:25.934934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a885973-ec40-4064-a607-6d587e6128f3 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:25.938692 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:25.939342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:25.939626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:25.939901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:25.996201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:25.997620 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440c60-c781-47f8-ba96-b99fa37a0171 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:26.006979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1346/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:27.770457 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:27.829918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba930bd-2358-41a7-8ea8-e6344dd86680 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:27.834413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:27.835315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:27.835596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:27.835866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] PATH_INFO: `/v3/users/d04782041e7342bea181514b42ff543f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:27.837032 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d04782041e7342bea181514b42ff543f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:27.838957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:27.882929 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd04782041e7342bea181514b42ff543f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:27.894101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd04782041e7342bea181514b42ff543f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:27.894781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd04782041e7342bea181514b42ff543f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:27.901404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd04782041e7342bea181514b42ff543f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:27.908436 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd04782041e7342bea181514b42ff543f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:27.914784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1339/2685] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:27 2022] DELETE /identity/v3/users/d04782041e7342bea181514b42ff543f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:27.919348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:27.919816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:27.919913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:27.937432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:27.938699 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:27.995951 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1347/2686] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:28.005894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.007327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.063411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362e529-5361-43fa-82aa-08fe136efab2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.067007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.067910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.068188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.068464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.077210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.078655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.088350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1340/2687] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:28.325356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.326789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.340666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127afd58-695f-4218-9b1c-4486cc34da60 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.349531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.350350 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.350604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.350853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.351178 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] PATH_INFO: `/v3/users/9beec2b6f8a84833a0cd7a1f10faa15f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.352170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.353110 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9beec2b6f8a84833a0cd7a1f10faa15f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.355211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.370545 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474459cb-9bb1-4921-8ee2-f4ca476eea1d service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.381238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.382463 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.382977 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.383345 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] PATH_INFO: `/v3/projects/d74d0f9b1d764502bba880c708073a28` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.385040 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d74d0f9b1d764502bba880c708073a28)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.387160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.412980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9beec2b6f8a84833a0cd7a1f10faa15f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.425152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9beec2b6f8a84833a0cd7a1f10faa15f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.425802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9beec2b6f8a84833a0cd7a1f10faa15f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.426531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9beec2b6f8a84833a0cd7a1f10faa15f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.434899 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4cb96254-8025-4d0c-aa76-22cf57d815f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9beec2b6f8a84833a0cd7a1f10faa15f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.436733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd74d0f9b1d764502bba880c708073a28', 'request_id': 'req-73591beb-e367-4ef8-939b-56f39e2711e2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.442916 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd74d0f9b1d764502bba880c708073a28', 'request_id': 'req-73591beb-e367-4ef8-939b-56f39e2711e2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.447408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1348/2688] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:28 2022] DELETE /identity/v3/users/9beec2b6f8a84833a0cd7a1f10faa15f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:28.450758 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd74d0f9b1d764502bba880c708073a28', 'request_id': 'req-73591beb-e367-4ef8-939b-56f39e2711e2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.451768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.452048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.452326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.462668 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] The token cache is being invalidate because project d74d0f9b1d764502bba880c708073a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:28.462955 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.463607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.465135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1341/2689] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:28 2022] DELETE /identity/v3/projects/d74d0f9b1d764502bba880c708073a28 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:28.468957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.469826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:28.470224 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.471072 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.530274 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1349/2690] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:28.532369 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73591beb-e367-4ef8-939b-56f39e2711e2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.539930 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.541242 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.544194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.545093 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.545377 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.545655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] PATH_INFO: `/v3/users/68773f8a8e004291aa630b5fccd7117c` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.546895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68773f8a8e004291aa630b5fccd7117c)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.548883 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.597191 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68773f8a8e004291aa630b5fccd7117c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.597695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af4a3e1-0fc9-42a8-93cb-3b4d636a8334 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.601703 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.602452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.602888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.603292 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.609235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68773f8a8e004291aa630b5fccd7117c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.609927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68773f8a8e004291aa630b5fccd7117c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.612622 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.614174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.616779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68773f8a8e004291aa630b5fccd7117c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.623587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1350/2691] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:28.623860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-fc08f76f-cec4-4d51-a9fe-966cedfe7bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68773f8a8e004291aa630b5fccd7117c'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.624377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.625662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.630981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1342/2692] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:28 2022] DELETE /identity/v3/users/68773f8a8e004291aa630b5fccd7117c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:28.638619 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36f1eb-2664-468d-ac92-2b0fdcbbd10b service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.693649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.694533 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.694850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.695129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] PATH_INFO: `/v3/users/1c2dc3305a8b4a4595ae4c3958cbd06a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.696348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c2dc3305a8b4a4595ae4c3958cbd06a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.698256 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:28.745201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c2dc3305a8b4a4595ae4c3958cbd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.757656 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c2dc3305a8b4a4595ae4c3958cbd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.758969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c2dc3305a8b4a4595ae4c3958cbd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.759706 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c2dc3305a8b4a4595ae4c3958cbd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.767278 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c2dc3305a8b4a4595ae4c3958cbd06a'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:28.780226 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1351/2693] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:28 2022] DELETE /identity/v3/users/1c2dc3305a8b4a4595ae4c3958cbd06a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:28.784745 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.785310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.785310 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.803363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:28.804576 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.880233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1343/2694] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:28.894078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:28.895676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:28.962932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf907f0-366e-4088-90d4-ee615e2e826a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:28.972931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:28.974164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:28.974523 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:28.974893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:28.985850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:28.987392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.000934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1352/2695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:29.026841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.028844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.039522 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.041154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.057487 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327050b-f68a-4483-a195-7a109b750a69 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.061313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7122f-479a-4f56-95ff-2f3bfa2e543b None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.064196 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.065148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.065496 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.065774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] PATH_INFO: `/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.068534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa10b6ca173b47f28ce4e9162f7123c6)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.071410 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.072559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.074478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.075862 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.076142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] PATH_INFO: `/v3/projects/ade8379defa140df93890047862f2e63` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.077580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ade8379defa140df93890047862f2e63)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.079895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.121964 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa10b6ca173b47f28ce4e9162f7123c6', 'request_id': 'req-e93507f4-ded8-4477-9b8f-32f67f384c69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.128503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa10b6ca173b47f28ce4e9162f7123c6', 'request_id': 'req-e93507f4-ded8-4477-9b8f-32f67f384c69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.135088 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ade8379defa140df93890047862f2e63', 'request_id': 'req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.138670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa10b6ca173b47f28ce4e9162f7123c6', 'request_id': 'req-e93507f4-ded8-4477-9b8f-32f67f384c69'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.141326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ade8379defa140df93890047862f2e63', 'request_id': 'req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.149967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ade8379defa140df93890047862f2e63', 'request_id': 'req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.152155 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] The token cache is being invalidate because project aa10b6ca173b47f28ce4e9162f7123c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:29.152550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.153307 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e93507f4-ded8-4477-9b8f-32f67f384c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.155723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1353/2696] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/projects/aa10b6ca173b47f28ce4e9162f7123c6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:29.160174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0bb6d-26c6-429b-bc90-9393767d10c8 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.160625 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0bb6d-26c6-429b-bc90-9393767d10c8 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.161085 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0bb6d-26c6-429b-bc90-9393767d10c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.162272 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] The token cache is being invalidate because project ade8379defa140df93890047862f2e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:29.162559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.163239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.167767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1344/2697] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/projects/ade8379defa140df93890047862f2e63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:29.168727 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.172501 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.184225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-2ac0bb6d-26c6-429b-bc90-9393767d10c8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:29.186762 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-2ac0bb6d-26c6-429b-bc90-9393767d10c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.251576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1354/2698] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:29.254991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2eee8-4b24-4edd-9b8a-e129f4d71cd4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.259220 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.259583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.259855 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.260618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.261741 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.262120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.262502 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] PATH_INFO: `/v3/users/12ac51cc402e4725a04bd9c7f1546c5f` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.263831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12ac51cc402e4725a04bd9c7f1546c5f)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.265815 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.278168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:29.279486 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.289158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1355/2699] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:29.293080 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.303009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dac093-bfb3-45ce-9454-cd7ef6bd9279 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.308117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.308849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.309294 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.309463 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.310190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:29.313314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.313314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.318743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12ac51cc402e4725a04bd9c7f1546c5f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.329980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1356/2700] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:29.329980 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.331823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.336627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12ac51cc402e4725a04bd9c7f1546c5f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.337736 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12ac51cc402e4725a04bd9c7f1546c5f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.345005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e82ca-6274-43c3-8f84-39f2bcfd699e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.345098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12ac51cc402e4725a04bd9c7f1546c5f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.351023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.351876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.352117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.352388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] PATH_INFO: `/v3/projects/a961b06c88e84c9bb5233e0f78c8ccf8` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.353199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12ac51cc402e4725a04bd9c7f1546c5f'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.353565 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a961b06c88e84c9bb5233e0f78c8ccf8)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.355561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.359125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1345/2701] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/users/12ac51cc402e4725a04bd9c7f1546c5f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:29.362253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.362253 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.404154 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a961b06c88e84c9bb5233e0f78c8ccf8', 'request_id': 'req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.410066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a961b06c88e84c9bb5233e0f78c8ccf8', 'request_id': 'req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.419563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a961b06c88e84c9bb5233e0f78c8ccf8', 'request_id': 'req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.433579 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] The token cache is being invalidate because project a961b06c88e84c9bb5233e0f78c8ccf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:29.433958 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.434820 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.435650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671e7d0-4870-45cd-aefd-1bac0a005942 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.436608 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1357/2702] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/projects/a961b06c88e84c9bb5233e0f78c8ccf8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:29.440876 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.442688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.503322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.503322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.503322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.503322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.503644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.506026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.512101 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fdf73-98df-4fa0-8e1c-6b490a1bda64 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.518243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.519025 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.519311 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.519587 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] PATH_INFO: `/v3/users/5b3ae3e5b67b4c70abf99afd8589abb5` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.520890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b3ae3e5b67b4c70abf99afd8589abb5)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.523031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.533930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1346/2703] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/projects => generated 367 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:29.538910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.540994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.575113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b3ae3e5b67b4c70abf99afd8589abb5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.588778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b3ae3e5b67b4c70abf99afd8589abb5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.589529 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b3ae3e5b67b4c70abf99afd8589abb5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.590263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b3ae3e5b67b4c70abf99afd8589abb5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.600643 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b3ae3e5b67b4c70abf99afd8589abb5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.611908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d5e53-cd45-40e7-8f2a-46b3aaf6f7dd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.616012 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1358/2704] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/users/5b3ae3e5b67b4c70abf99afd8589abb5 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:29.620223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.620992 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.621478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.621718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.622667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.624959 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.648800 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.650263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.654241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1347/2705] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:29.655432 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.657768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.674771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836dc333-8f3f-434b-820a-3da010290618 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.738725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.739649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.740004 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.740282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.741126 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.742854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.743211 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb19cf9-a514-49e5-b5b1-85ddfa16720b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.748577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.749563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.749956 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.750290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] PATH_INFO: `/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.751785 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8289352e0d94c7c983db4fd4d2a9a5a)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.756657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.756850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1348/2706] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:29.758409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.769215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c300f0c-af9f-4d51-8c4b-cd7f64309fc2 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.774930 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.775610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.775892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.776167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.777480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.779137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.791823 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1349/2707] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:29.795809 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.807583 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab2c18-fb50-45f3-9c09-e9f9961f05e9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:29.823427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8289352e0d94c7c983db4fd4d2a9a5a', 'request_id': 'req-4627c0bc-3db3-424d-ab11-052ef0183e63'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.829104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8289352e0d94c7c983db4fd4d2a9a5a', 'request_id': 'req-4627c0bc-3db3-424d-ab11-052ef0183e63'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.838059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8289352e0d94c7c983db4fd4d2a9a5a', 'request_id': 'req-4627c0bc-3db3-424d-ab11-052ef0183e63'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.850399 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] The token cache is being invalidate because project e8289352e0d94c7c983db4fd4d2a9a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:29.850738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.851431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4627c0bc-3db3-424d-ab11-052ef0183e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:29.853003 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1359/2708] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/projects/e8289352e0d94c7c983db4fd4d2a9a5a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:29.858734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df5cf-3663-43f9-8f18-c2c909c22b53 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.859091 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df5cf-3663-43f9-8f18-c2c909c22b53 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.859441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816df5cf-3663-43f9-8f18-c2c909c22b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.874980 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:29.875910 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.876188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.876462 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] PATH_INFO: `/v3/projects/7a2d6bccf25c406d821b5d28ab105565/users/4cb02085b099466aa7182a937c1051e2/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.878367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-816df5cf-3663-43f9-8f18-c2c909c22b53 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:29.880950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-816df5cf-3663-43f9-8f18-c2c909c22b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.890794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1360/2709] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:29.891165 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2d6bccf25c406d821b5d28ab105565, user_id=4cb02085b099466aa7182a937c1051e2, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:29.893886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddf46e1-a31d-4951-b645-39db5d142d24 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:29.902480 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.903018 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.903298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.921451 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1350/2710] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:29 2022] PUT /identity/v3/projects/7a2d6bccf25c406d821b5d28ab105565/users/4cb02085b099466aa7182a937c1051e2/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:29.923423 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:29.924604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.933343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:29.933644 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:29.933909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:29.968309 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] MFA Rules not processed for user `4cb02085b099466aa7182a937c1051e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:29.969973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.985635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1361/2711] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:29.986481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:29.987844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:29.999244 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9011ee1-b307-42eb-a89f-dab132261094 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.004078 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.005811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.006095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.006370 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] PATH_INFO: `/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.007995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdb4c66613c40c8b7c56825f06c84cc)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.009950 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.037510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1351/2712] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:29 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:30.038524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.050597 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26146a8b-08ca-4e64-9432-96f5e1c57a68 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.057017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdb4c66613c40c8b7c56825f06c84cc', 'request_id': 'req-78a65526-da03-4487-b55e-1f84c7b409db'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.062259 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdb4c66613c40c8b7c56825f06c84cc', 'request_id': 'req-78a65526-da03-4487-b55e-1f84c7b409db'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.070406 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdb4c66613c40c8b7c56825f06c84cc', 'request_id': 'req-78a65526-da03-4487-b55e-1f84c7b409db'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.081444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] The token cache is being invalidate because project 0bdb4c66613c40c8b7c56825f06c84cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:30.081730 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.082363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.085174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1362/2713] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:29 2022] DELETE /identity/v3/projects/0bdb4c66613c40c8b7c56825f06c84cc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:30.085865 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.087179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.112882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.113551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.113860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.114247 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.115289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:30.115600 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.117199 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09263b10-810a-4965-8087-5ab7ae279b73 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.128553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1352/2714] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:20:30.130238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.130527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.130895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.143024 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a65526-da03-4487-b55e-1f84c7b409db admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.147420 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8730a384ede5490eaa8e818e7c60518d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.148103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.149036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.149322 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:30.149425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.150508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.151160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.158343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1353/2715] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:30.159123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.160311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.171936 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8aecdd-3b8f-44d8-923e-71aeae0a63c9 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.176725 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.177383 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.177655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.177939 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.178678 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.180570 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2328183-f28a-430d-923a-537d6e7b8679 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.205569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1354/2716] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:30.206880 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.207170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.207507 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.211415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.212841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.221782 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1363/2717] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:30.222662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.227292 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:30.228487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.233129 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca888d-f37c-49cd-add0-59058ac194fc service glance] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.293139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.293963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.294252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.294798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.295431 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.297417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.307177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1355/2718] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:30.311018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.322508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad0273-84b6-4b5f-9a4b-ff3c55fb4b9e None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.326981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1364/2719] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:30.327852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.331089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.331781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.332062 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.332334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.333637 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:30.333991 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.335777 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.339884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f77ea6-335e-4a30-aba2-05b57ff5d45a admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.345089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.345798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.346090 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.346365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.347130 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.352580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1356/2720] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:30.352734 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.353627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.362662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1365/2721] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:30.363647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.367731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ce66cb-c3cf-44b7-b11e-2dec77164995 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.373131 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.373783 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.374114 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.374332 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.375068 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.375172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f656cab5-193d-4ced-b536-9eea9b97629c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.377281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.382031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.383014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.383250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.383597 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.384400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.386071 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.398994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1366/2722] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:30.403567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.407569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1357/2723] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:30.412440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.414841 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939188e-fa2a-4d53-bd2d-1c7a4a883d99 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.477633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.478534 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.479298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.479425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d4e01-b19c-49d0-80ea-d9b984986d64 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.479578 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] PATH_INFO: `/v3/projects/9ae1d706ae8848d698335b6513d297a0/users/51f0feffbe554e2b9276c275b124be24/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.484289 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.485027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.485375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.485719 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.486478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.488536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.497648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ae1d706ae8848d698335b6513d297a0, user_id=51f0feffbe554e2b9276c275b124be24, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.500777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee34d3e-80eb-4786-aa41-459c6dec3a53 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.510792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1358/2724] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:20:30.514839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1367/2725] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:30 2022] PUT /identity/v3/projects/9ae1d706ae8848d698335b6513d297a0/users/51f0feffbe554e2b9276c275b124be24/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:30.515143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.525654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c71953-0612-4096-82da-1a69f7a1b546 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.526833 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.527194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.527541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.556469 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] MFA Rules not processed for user `51f0feffbe554e2b9276c275b124be24`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:30.557676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.587580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.588255 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.588541 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.588816 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.589555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.591182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.601645 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1359/2726] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:30.605629 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.617874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c19588-40f6-4dc4-80a6-b8d8f55facc8 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.623010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.623675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.623960 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.624235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.624961 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.626562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.631548 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1368/2727] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:30.647511 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.648163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1360/2728] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:30.651843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.652123 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.663567 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81114f45-e35d-4b54-be89-fe07db275b7a admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.668903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.670201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.670553 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.670987 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] PATH_INFO: `/v3/projects/80325ab76d5546bcaa28db2c45cc6515/users/a5be9f84a3b54d1cab7006c0899720aa/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.690306 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80325ab76d5546bcaa28db2c45cc6515, user_id=a5be9f84a3b54d1cab7006c0899720aa, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.693603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ead68-9389-4d42-bcf5-f7d0db3fe313 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.713179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1361/2729] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:30 2022] PUT /identity/v3/projects/80325ab76d5546bcaa28db2c45cc6515/users/a5be9f84a3b54d1cab7006c0899720aa/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:30.713913 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ef78c8-43be-4fb5-9bfd-a77e418a9ba5 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.714819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.715148 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.715427 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.733856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:30.735139 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.767393 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.768050 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.768353 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.768628 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.793611 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1362/2730] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:30.803788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.805080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:30.828943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.830426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.839708 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1369/2731] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:30.859065 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:30.865109 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7868330-b21e-4614-8158-4ecd99c044a4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.869343 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.870083 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.870368 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.870679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.870945 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee4dc08-b3da-4dfc-a22f-5d78f4bf1e54 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:30.875580 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:30.876451 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.876725 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.876978 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] PATH_INFO: `/v3/users/51f0feffbe554e2b9276c275b124be24` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.878161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=51f0feffbe554e2b9276c275b124be24)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.880998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.885216 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:30.886670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2ff05-7231-4573-a299-17ce5fbb739f service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:30.897239 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1363/2732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:30.931300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51f0feffbe554e2b9276c275b124be24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.945066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51f0feffbe554e2b9276c275b124be24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.945812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51f0feffbe554e2b9276c275b124be24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.946434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51f0feffbe554e2b9276c275b124be24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.953334 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51f0feffbe554e2b9276c275b124be24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:30.966394 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1370/2733] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:30 2022] DELETE /identity/v3/users/51f0feffbe554e2b9276c275b124be24 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:20:30.971466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:30.971792 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:30.972076 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:30.990818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:30.992028 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.059404 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1364/2734] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:31.067890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.069444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.136746 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df1897-921f-4b48-b759-fd057cd06aec admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:31.141179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:31.141842 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.142124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.142400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.152111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:31.153576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ecd845-1b2e-45ad-9e9a-81144b9980ec service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:31.164790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1371/2735] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:31.608804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.610206 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.623705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9b86ab-32e5-490b-a139-e1a9c72579de None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:31.628651 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:31.629563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.629842 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.630116 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] PATH_INFO: `/v3/projects/9ae1d706ae8848d698335b6513d297a0` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.631356 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ae1d706ae8848d698335b6513d297a0)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:31.633536 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:31.687543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ae1d706ae8848d698335b6513d297a0', 'request_id': 'req-6d7ac8d9-c903-4e82-965b-7bc77f810d91'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:31.687736 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141282-bd04-42d9-8062-18f1759a128b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.687884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141282-bd04-42d9-8062-18f1759a128b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.688143 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87141282-bd04-42d9-8062-18f1759a128b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.694084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ae1d706ae8848d698335b6513d297a0', 'request_id': 'req-6d7ac8d9-c903-4e82-965b-7bc77f810d91'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:31.717213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ae1d706ae8848d698335b6513d297a0', 'request_id': 'req-6d7ac8d9-c903-4e82-965b-7bc77f810d91'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:31.719647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-87141282-bd04-42d9-8062-18f1759a128b None None] MFA Rules not processed for user `a5be9f84a3b54d1cab7006c0899720aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:31.720894 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-87141282-bd04-42d9-8062-18f1759a128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.737743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] The token cache is being invalidate because project 9ae1d706ae8848d698335b6513d297a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:31.738177 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:31.740886 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-6d7ac8d9-c903-4e82-965b-7bc77f810d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:31.743970 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1365/2736] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:31 2022] DELETE /identity/v3/projects/9ae1d706ae8848d698335b6513d297a0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:31.748654 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1120b-f8f0-4563-a4fb-dc8fd199273c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.757071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1120b-f8f0-4563-a4fb-dc8fd199273c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.757071 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1120b-f8f0-4563-a4fb-dc8fd199273c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.775872 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-31f1120b-f8f0-4563-a4fb-dc8fd199273c None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:31.777278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-31f1120b-f8f0-4563-a4fb-dc8fd199273c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.796234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1372/2737] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:31.809641 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87141282-bd04-42d9-8062-18f1759a128b None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.812650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-87141282-bd04-42d9-8062-18f1759a128b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.844459 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1366/2738] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:31.852687 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.852975 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.853250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.877295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87141282-bd04-42d9-8062-18f1759a128b None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:31.878947 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:31.880873 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:31.881383 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:31.882165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.882450 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.882768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.889498 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1367/2739] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:31.891365 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:31.892812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:31.893589 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.903626 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1373/2740] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:20:31.904829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe95dd0-88c3-41d0-b46e-27575c4363ae None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:31.909765 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:31.910434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.911375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.912204 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.912941 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:20:31.913250 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:31.914888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:31.927806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1368/2741] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:20:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:20:31.932212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.944481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24207359-4cf5-4747-a1c0-700e8c92e776 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:31.949205 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:31.950040 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:31.950388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:31.950700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:31.951397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:31.953290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:31.986624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1374/2742] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:20:31 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:31.989836 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:31.999434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faca7a7-88b9-428f-b924-cd31e29b4cfd admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:32.064019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:32.065115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.065606 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.066149 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.067041 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:32.069376 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:32.089988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1369/2743] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:20:31 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:20:32.094255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:32.107670 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a33be-e8f4-4844-abf1-cadfa0138c3e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:32.112969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:32.113718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.114492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.114492 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.115385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:32.117136 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:32.132718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1375/2744] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:20:32.133370 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:32.148261 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844a80-1a8a-433a-93fe-54991e0f4ad0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:32.154361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:32.155073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.155353 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.155623 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.156569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:32.158166 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a15c20-bc33-4180-bad9-345f46f2ea67 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:32.169394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1370/2745] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 17 18:20:32.173581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:32.185673 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd4118-8a3b-407d-a70f-3d1043ea0171 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:32.198193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:32.201346 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.201634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.201942 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] PATH_INFO: `/v3/projects/2bad44934cd94e4fa3d80ee04993dbe9/users/590063caf3094f5bbaae4713da08698f/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.219531 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bad44934cd94e4fa3d80ee04993dbe9, user_id=590063caf3094f5bbaae4713da08698f, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:32.222232 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:32.238291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1376/2746] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:20:32 2022] PUT /identity/v3/projects/2bad44934cd94e4fa3d80ee04993dbe9/users/590063caf3094f5bbaae4713da08698f/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:32.251896 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c94b-5a23-4a31-b8e7-86c213d37cd5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.252563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c94b-5a23-4a31-b8e7-86c213d37cd5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.252989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3025c94b-5a23-4a31-b8e7-86c213d37cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.286198 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3025c94b-5a23-4a31-b8e7-86c213d37cd5 None None] MFA Rules not processed for user `590063caf3094f5bbaae4713da08698f`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:32.287434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3025c94b-5a23-4a31-b8e7-86c213d37cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:32.349212 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1371/2747] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:32.360926 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:32.417160 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f915083-bbe8-4fc5-b3c3-8e604b04adf3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:32.420783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:32.421426 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:32.421704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:32.421974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:32.430029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:32.431473 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:32.443810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1377/2748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:33.259474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa063-dc08-4461-a42e-271c928d13c4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:33.260099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa063-dc08-4461-a42e-271c928d13c4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:33.260099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0aa063-dc08-4461-a42e-271c928d13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:33.277300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5d0aa063-dc08-4461-a42e-271c928d13c4 None None] MFA Rules not processed for user `a5be9f84a3b54d1cab7006c0899720aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:33.278474 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5d0aa063-dc08-4461-a42e-271c928d13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:33.332154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1372/2749] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:56.148695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:56.150290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:56.229973 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a6e7a-12ad-47d7-8295-2406111d4f7e service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:56.239082 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:56.240059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:56.240448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:56.240866 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:56.243380 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:56.255542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:56.257309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:56.267845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1378/2750] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:56.989321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cc43-1144-4be1-9c21-c5a01ae3077c None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:56.989819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cc43-1144-4be1-9c21-c5a01ae3077c None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:56.989922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5cc43-1144-4be1-9c21-c5a01ae3077c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:57.007301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e2b5cc43-1144-4be1-9c21-c5a01ae3077c None None] MFA Rules not processed for user `a5be9f84a3b54d1cab7006c0899720aa`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:57.008466 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e2b5cc43-1144-4be1-9c21-c5a01ae3077c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:57.015321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1373/2751] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:20:57.180009 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:57.241478 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0de18-b8b2-404f-bdda-d3197fd55e3e service placement] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:57.245985 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:57.246892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:57.247175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:57.247467 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] PATH_INFO: `/v3/users/590063caf3094f5bbaae4713da08698f` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:57.248642 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=590063caf3094f5bbaae4713da08698f)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:57.250530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:57.295922 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '590063caf3094f5bbaae4713da08698f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.308105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '590063caf3094f5bbaae4713da08698f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.308804 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '590063caf3094f5bbaae4713da08698f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.309427 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '590063caf3094f5bbaae4713da08698f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.317145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '590063caf3094f5bbaae4713da08698f'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.330341 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1379/2752] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:20:57 2022] DELETE /identity/v3/users/590063caf3094f5bbaae4713da08698f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:20:57.335478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:57.335766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:57.336065 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:57.355057 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:20:57.356240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:57.414618 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1374/2753] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:20:57.424145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:57.425802 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:57.481789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b688d6-b24b-4f51-bf24-40d6651eb6da admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:57.485415 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:57.486068 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:57.486352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:57.486655 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:57.495649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:57.497711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:57.508029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1380/2754] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:20:57.822008 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:20:57.823548 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:20:57.837450 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0e445-d383-45c6-aa2c-4f9bbb167203 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:20:57.843029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:20:57.844433 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:20:57.844895 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:20:57.845327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] PATH_INFO: `/v3/projects/2bad44934cd94e4fa3d80ee04993dbe9` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:20:57.846781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bad44934cd94e4fa3d80ee04993dbe9)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:20:57.849779 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:20:57.938050 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bad44934cd94e4fa3d80ee04993dbe9', 'request_id': 'req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.944620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bad44934cd94e4fa3d80ee04993dbe9', 'request_id': 'req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.954104 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bad44934cd94e4fa3d80ee04993dbe9', 'request_id': 'req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.970791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] The token cache is being invalidate because project 2bad44934cd94e4fa3d80ee04993dbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:20:57.971136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.971810 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-55e70fa7-05ac-48dc-ac8c-3cfab6da3137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:20:57.975854 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1375/2755] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:20:57 2022] DELETE /identity/v3/projects/2bad44934cd94e4fa3d80ee04993dbe9 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:06.693059 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:06.694517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:06.707508 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8deb3-011a-4832-8b29-5fc2960454c8 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:06.763419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:06.764290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:06.764574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:06.764854 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] PATH_INFO: `/v3/users/4cb02085b099466aa7182a937c1051e2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:06.766023 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cb02085b099466aa7182a937c1051e2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:06.768089 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:06.812213 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cb02085b099466aa7182a937c1051e2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:06.824309 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cb02085b099466aa7182a937c1051e2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:06.824969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cb02085b099466aa7182a937c1051e2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:06.825569 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cb02085b099466aa7182a937c1051e2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:06.833093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cb02085b099466aa7182a937c1051e2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:06.844877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1381/2756] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:21:06 2022] DELETE /identity/v3/users/4cb02085b099466aa7182a937c1051e2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:06.849340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:06.849832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:06.849949 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:06.867603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:06.868859 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:06.937153 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1376/2757] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:06.947863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:06.949261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.005005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf22d21-0338-485e-be7c-f179a5933211 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.008647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.009290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.009575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.009850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.018679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.020095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff5b15-06a3-4042-a1db-e78058e9101a service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.029387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1382/2758] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:07.293643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.295181 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.307634 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42f8969-a709-4817-b0eb-10a9560125c8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.314631 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.315563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.315844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.316120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] PATH_INFO: `/v3/projects/7a2d6bccf25c406d821b5d28ab105565` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.317966 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2d6bccf25c406d821b5d28ab105565)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.320033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.366976 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2d6bccf25c406d821b5d28ab105565', 'request_id': 'req-096b602d-ee43-4683-9aef-f0e4422e782d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.372399 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2d6bccf25c406d821b5d28ab105565', 'request_id': 'req-096b602d-ee43-4683-9aef-f0e4422e782d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.379864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2d6bccf25c406d821b5d28ab105565', 'request_id': 'req-096b602d-ee43-4683-9aef-f0e4422e782d'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.391030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] The token cache is being invalidate because project 7a2d6bccf25c406d821b5d28ab105565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:21:07.391319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.391994 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-096b602d-ee43-4683-9aef-f0e4422e782d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:07.393602 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1377/2759] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:21:07 2022] DELETE /identity/v3/projects/7a2d6bccf25c406d821b5d28ab105565 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:07.398590 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.398893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.399169 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.416724 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:07.417912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.475797 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1383/2760] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:07.483527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.483818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.484095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.502793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:07.504080 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.512532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1378/2761] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:21:07.516912 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.526900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d9738-8e04-40e8-8e01-5e1b29bfa269 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.531472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.532118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.532419 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.532674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.533387 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:21:07.533691 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.535843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.546921 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1384/2762] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:21:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:21:07.551037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.560236 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98026c8c-494e-4171-b0ec-fe624bae5ef2 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.564901 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.565705 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.565990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.566266 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.566993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.569143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.594566 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1379/2763] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:07.599759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.609481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2894f-960a-49d1-bb93-27010b24e66b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.664696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.665381 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.665663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.665937 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.666650 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.668568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.687538 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1385/2764] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:07.691757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.702084 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3f88ae-7766-4ee2-b9ea-4f869987ffe9 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.707209 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.707865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.708147 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.708423 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.709144 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.710767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.720818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1380/2765] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:07.725354 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.735528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92491770-8244-4020-ba7d-94bf9f8fd06e admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.741056 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.741793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.742134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.742417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.743234 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.744852 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76309999-4ead-418f-87c7-3c4c9102b954 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.755919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1386/2766] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:07.760378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.770878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb6ff9-4e78-4cc8-9fc7-51239c6ce465 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.775478 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.776348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.776627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.776899 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] PATH_INFO: `/v3/projects/654b8506dab447a79f8f0c0314d5d918/users/488b0b1d152b471a973c5f7936361ef3/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.792743 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=654b8506dab447a79f8f0c0314d5d918, user_id=488b0b1d152b471a973c5f7936361ef3, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:07.795683 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:07.808957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1381/2767] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:07 2022] PUT /identity/v3/projects/654b8506dab447a79f8f0c0314d5d918/users/488b0b1d152b471a973c5f7936361ef3/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:07.821066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.821392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.821701 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:07.851607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] MFA Rules not processed for user `488b0b1d152b471a973c5f7936361ef3`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:07.852811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.917047 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1387/2768] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:07.928319 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:07.930048 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:07.987145 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831a64eb-2a05-4961-ae66-a089414847f1 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:07.991018 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:07.991664 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:07.991944 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:07.992215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:08.000318 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:08.001738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf1eb4a-837b-4dfe-a346-1596aade7c28 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:08.011291 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1382/2769] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:21:10.543132 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:10.602550 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abab18-f2a2-4f84-938c-c226f23503eb None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:10.607015 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:10.607881 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:10.608164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:10.608437 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] PATH_INFO: `/v3/users/488b0b1d152b471a973c5f7936361ef3` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:10.609607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=488b0b1d152b471a973c5f7936361ef3)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:10.611603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:10.655888 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '488b0b1d152b471a973c5f7936361ef3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:10.667682 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '488b0b1d152b471a973c5f7936361ef3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:10.668360 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '488b0b1d152b471a973c5f7936361ef3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:10.668962 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '488b0b1d152b471a973c5f7936361ef3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:10.676105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '488b0b1d152b471a973c5f7936361ef3'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:10.687783 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1388/2770] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:21:10 2022] DELETE /identity/v3/users/488b0b1d152b471a973c5f7936361ef3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:10.693375 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:10.693858 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:10.693957 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:10.711082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:10.712254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:10.771710 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1383/2771] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:10.781182 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:10.782755 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:10.844045 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37447e8f-b63e-488d-8217-d7621107b422 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:10.848114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:10.848877 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:10.849233 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:10.849537 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:10.859666 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:10.861098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c473a51-e9d2-40a3-8323-1fb2df8f7cf0 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:10.873105 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1389/2772] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:11.170759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.172431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:11.186282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797ef23-4bcf-47aa-b638-2424653e2c82 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.193488 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.194525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.194940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.195317 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] PATH_INFO: `/v3/projects/654b8506dab447a79f8f0c0314d5d918` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.196620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=654b8506dab447a79f8f0c0314d5d918)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.198702 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.245361 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '654b8506dab447a79f8f0c0314d5d918', 'request_id': 'req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:11.250620 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '654b8506dab447a79f8f0c0314d5d918', 'request_id': 'req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:11.258133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '654b8506dab447a79f8f0c0314d5d918', 'request_id': 'req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:11.269535 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] The token cache is being invalidate because project 654b8506dab447a79f8f0c0314d5d918 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:21:11.269822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:11.270552 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bc2ba346-cbbf-4ed0-ba9f-dd5ff79855a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:11.272124 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1384/2773] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:21:11 2022] DELETE /identity/v3/projects/654b8506dab447a79f8f0c0314d5d918 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:11.277057 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.277288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.277566 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.295793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:11.296994 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:11.356997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1390/2774] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:11.365761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.366051 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.366334 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.385894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:11.387273 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:11.395307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1385/2775] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:11.401127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.411974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48948277-7e5c-4dbd-b50c-8ca5e7d46056 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.421236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.421236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.421236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.421236 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.421704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:21:11.421704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.422955 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.438603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1391/2776] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:21:11.441339 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.450834 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d295fb-77af-4744-a3f7-a4f636f306db None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.455434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.456095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.456378 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.456655 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.457561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.460190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.490379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1386/2777] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:21:11 2022] POST /identity/v3/projects => generated 399 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:11.494908 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.505209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2103412-fea4-4159-9b70-47c180db06b3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.563054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.563879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.564200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.564500 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.565405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.568029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.590702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1392/2778] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:21:11 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:11.594826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.608348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f60e26-8d12-4210-abda-6c3376da5bba admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.613278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.613978 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.614254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.614508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.615278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.616877 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.628387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1387/2779] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:11.632581 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.642173 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f33672-5000-4b49-9010-491744dd3b3d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.647510 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.648161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.648441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.648713 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.649432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.651074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6046578-b9ef-4b95-9377-6f82a70cb296 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.661934 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1393/2780] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:11.665546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.675529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4002f7e7-aa64-40a8-a036-52aadb438805 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.680259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.681136 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.681514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.681888 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] PATH_INFO: `/v3/projects/5fc08d39bb2041bb9a0c9a260e181821/users/b0f86404d1704e07885a9658a0ba73c9/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.696327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc08d39bb2041bb9a0c9a260e181821, user_id=b0f86404d1704e07885a9658a0ba73c9, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.699099 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.712235 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1388/2781] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:11 2022] PUT /identity/v3/projects/5fc08d39bb2041bb9a0c9a260e181821/users/b0f86404d1704e07885a9658a0ba73c9/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:11.722400 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba9b-c122-4714-be77-2022411f8f4c None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.723376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba9b-c122-4714-be77-2022411f8f4c None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.723662 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bceba9b-c122-4714-be77-2022411f8f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.749611 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8bceba9b-c122-4714-be77-2022411f8f4c None None] MFA Rules not processed for user `b0f86404d1704e07885a9658a0ba73c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:11.750927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8bceba9b-c122-4714-be77-2022411f8f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:11.813719 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1394/2782] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:11.825026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:11.826768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:11.882465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d881131-2de6-4d54-94b8-6dfc5937b176 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:11.886333 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:11.887027 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:11.887315 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:11.887592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:11.897095 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:11.898878 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:11.908506 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1389/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:11 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:20.395743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:20.396261 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:20.396368 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:20.416088 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:20.417258 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:20.470034 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1395/2784] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:21:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:20.517223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:20.518639 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:20.585988 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13d7c9-6071-4699-8494-1c051e2f6c77 service cinder] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:20.591039 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:20.591622 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:20.591905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:20.592183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:20.600121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:20.601690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ab72f-d75a-4e77-b3da-737b710099e5 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:20.609460 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1390/2785] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:21:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:21:20.968905 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:21.046527 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e460fe5-c545-4913-853a-87184d6c3313 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:21.051412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:21.053190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.053618 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.054223 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] PATH_INFO: `/v3/users/b0f86404d1704e07885a9658a0ba73c9` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.056663 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f86404d1704e07885a9658a0ba73c9)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:21.060547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:21.135444 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f86404d1704e07885a9658a0ba73c9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.155321 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f86404d1704e07885a9658a0ba73c9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.156235 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f86404d1704e07885a9658a0ba73c9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.157060 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f86404d1704e07885a9658a0ba73c9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.165995 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f86404d1704e07885a9658a0ba73c9'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.184407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1396/2786] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:21:20 2022] DELETE /identity/v3/users/b0f86404d1704e07885a9658a0ba73c9 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:21.189132 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.189573 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.189715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.208715 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:21.210354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:21.276774 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1391/2787] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:21:21.287919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:21.289812 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:21.353843 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb0a38-7821-4937-aac9-8b389caacca8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:21.358054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:21.358853 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.359145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.359460 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.369798 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:21.371397 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e85148-053e-4cb8-8986-971930fb2c5a service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:21.393434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1397/2788] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:21:21.687510 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:21.689143 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:21.707496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a23eeb-32ae-430e-b81a-d7bd9b4d094d None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:21.715431 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:21.716396 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.716750 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.717037 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] PATH_INFO: `/v3/projects/5fc08d39bb2041bb9a0c9a260e181821` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.718257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc08d39bb2041bb9a0c9a260e181821)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:21.720401 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:21.777327 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc08d39bb2041bb9a0c9a260e181821', 'request_id': 'req-e6e9d746-5966-4ef1-b21a-be27ea559e05'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.783129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc08d39bb2041bb9a0c9a260e181821', 'request_id': 'req-e6e9d746-5966-4ef1-b21a-be27ea559e05'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.791918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc08d39bb2041bb9a0c9a260e181821', 'request_id': 'req-e6e9d746-5966-4ef1-b21a-be27ea559e05'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.804472 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] The token cache is being invalidate because project 5fc08d39bb2041bb9a0c9a260e181821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:21:21.804768 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.805529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-e6e9d746-5966-4ef1-b21a-be27ea559e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:21.810954 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1392/2789] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:21:21 2022] DELETE /identity/v3/projects/5fc08d39bb2041bb9a0c9a260e181821 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:21.812849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.813369 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.813479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.833573 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:21.834911 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:21.901430 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1398/2790] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:21.907533 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.907829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.908169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.930819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:21.932029 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:21.940241 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1393/2791] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:21.945183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:21.955499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b888fd0-becd-40cf-b177-173f8a6cb44d None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:21.961168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:21.961928 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:21.962290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:21.962850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:21.963702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:21:21.964049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:21.965752 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:21.992291 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1399/2792] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:21:21.993864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.003233 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e524a256-8b64-4257-a388-4bb6ffeca17a None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.009569 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.010243 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.010527 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.010841 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.011680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.013580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.042424 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1394/2793] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:21:21 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:21:22.046377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.058452 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca67033-5e9c-4a50-822f-a8df69f1e8a3 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.123766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.124470 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.124743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.125152 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.125723 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.127704 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.150635 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1400/2794] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:21:22 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:21:22.154496 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.166038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd03e97-eefb-4995-b79a-5f7acdedb726 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.172120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.172830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.173115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.173395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.174118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.176520 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.192903 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1395/2795] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:22.194111 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.204326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6c8fd3-7ba7-4852-b9c3-10cc78251cd6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.209174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.209849 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.210131 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.210407 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.211297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.212907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a574acb-c8c9-4e99-b31d-e6bc016fcee8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.226607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1401/2796] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:22.230189 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.241341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccfbfc3-2859-4d42-9433-8c2e8f18df32 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.246055 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.246981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.247265 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.247546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] PATH_INFO: `/v3/projects/43c948c388ed4ad7bd63255d5c643e11/users/240c3f3cc9e943a883e08e6c096edc51/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.273627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c948c388ed4ad7bd63255d5c643e11, user_id=240c3f3cc9e943a883e08e6c096edc51, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.276588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.297394 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1396/2797] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:22 2022] PUT /identity/v3/projects/43c948c388ed4ad7bd63255d5c643e11/users/240c3f3cc9e943a883e08e6c096edc51/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:22.299238 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78a9b-5df6-4ea2-aa20-279594ecbe8e None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.299535 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78a9b-5df6-4ea2-aa20-279594ecbe8e None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.299848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f78a9b-5df6-4ea2-aa20-279594ecbe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.320975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-c1f78a9b-5df6-4ea2-aa20-279594ecbe8e None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:22.322525 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c1f78a9b-5df6-4ea2-aa20-279594ecbe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:22.388252 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1402/2798] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:21:22.397140 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:22.399183 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:22.473434 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce32ce2-09b5-4c93-a563-b534479dd356 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:22.480778 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:22.481967 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:22.482844 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:22.483154 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:22.499430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:22.500867 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:22.516468 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1397/2799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:27.569714 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:27.570177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:27.570313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:27.611845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] MFA Rules not processed for user `240c3f3cc9e943a883e08e6c096edc51`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:27.613104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:27.717081 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1403/2800] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:27.721581 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:27.732924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef013b-a312-4e27-a20a-1e0d0924b53a service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:27.742998 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:27.743846 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:27.744229 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:27.744718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:27.745642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:27.747761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:27.802179 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1398/2801] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 17 18:21:27.803481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:27.818560 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e32f5-3c4d-439b-a08b-89212a051098 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:27.960826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:27.962324 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:27.976575 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:27.978518 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:27.979479 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:27.981644 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:28.015712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1404/2802] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:21:27 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:28.020733 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:28.046483 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de426c21-7dcd-4b37-ac6f-76f40034db44 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:28.052464 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:28.053411 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:28.053905 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:28.054344 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:28.055125 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:28.056933 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:28.072425 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1399/2803] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:28.073763 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:28.087010 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68b79d3-d4db-48c1-ae79-25b3df594267 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:28.092165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:28.093194 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:28.093589 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:28.093959 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] PATH_INFO: `/v3/projects/19b8064243064c04a61f593cc7927944/users/eead850a5fb94eb5b68f20e81117eb0e/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:28.115029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b8064243064c04a61f593cc7927944, user_id=eead850a5fb94eb5b68f20e81117eb0e, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:28.118099 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:28.139850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1405/2804] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:28 2022] PUT /identity/v3/projects/19b8064243064c04a61f593cc7927944/users/eead850a5fb94eb5b68f20e81117eb0e/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:28.145278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:28.157033 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5562f961-ff09-4faf-a6b5-1ba5389a8df0 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:28.248508 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:28.249440 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:28.249732 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:28.250101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:28.250984 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:28.253650 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086c7f5-c2ec-4f36-8220-721e7801b9d3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:28.267950 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1400/2805] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:28.272712 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:28.284352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a07bd-8f42-4c0c-9f20-3f7ece1931c6 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:28.290308 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:28.291624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:28.292221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:28.292221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] PATH_INFO: `/v3/projects/19b8064243064c04a61f593cc7927944/users/eead850a5fb94eb5b68f20e81117eb0e/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:28.294604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b8064243064c04a61f593cc7927944, user_id=eead850a5fb94eb5b68f20e81117eb0e, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:28.297350 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:28.319022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1406/2806] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:28 2022] PUT /identity/v3/projects/19b8064243064c04a61f593cc7927944/users/eead850a5fb94eb5b68f20e81117eb0e/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:34.350429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da705-9671-4fa6-a9a5-8a428c44c9fd None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:34.350989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da705-9671-4fa6-a9a5-8a428c44c9fd None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:34.351078 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404da705-9671-4fa6-a9a5-8a428c44c9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:34.392893 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-404da705-9671-4fa6-a9a5-8a428c44c9fd None None] MFA Rules not processed for user `eead850a5fb94eb5b68f20e81117eb0e`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:34.395757 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-404da705-9671-4fa6-a9a5-8a428c44c9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:34.498135 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1401/2807] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:34.518197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:34.522117 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:34.640032 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaadc55-c76a-4527-8da3-1d07088a4e2c admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:34.650207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:34.651359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:34.652033 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:34.652567 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:34.750583 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:34.752558 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726038f-049b-44b1-8cf5-4816d90b3124 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:34.765363 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1407/2808] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:36.323196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:36.324196 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:36.324534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:36.355409 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] MFA Rules not processed for user `240c3f3cc9e943a883e08e6c096edc51`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:36.356985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:36.373578 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1402/2809] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:41.749079 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:41.749561 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:41.749677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:41.767020 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:41.768204 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:41.827084 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1408/2810] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:41.840358 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:41.841716 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:41.908138 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7adfcf8-aff3-491b-93f5-b2cf4377e6e1 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:41.913066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:41.913769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:41.914046 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:41.914321 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:41.922596 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:41.924205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:41.933160 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1403/2811] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:21:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:21:43.853318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:43.854870 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:43.919677 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45b669-38ce-4155-8529-356b84b0b742 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:43.924218 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:43.925965 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:43.926693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:43.926693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] PATH_INFO: `/v3/users/a5be9f84a3b54d1cab7006c0899720aa` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:43.927743 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5be9f84a3b54d1cab7006c0899720aa)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:43.929648 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:43.981273 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5be9f84a3b54d1cab7006c0899720aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:43.993442 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5be9f84a3b54d1cab7006c0899720aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:43.994100 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5be9f84a3b54d1cab7006c0899720aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:43.994737 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5be9f84a3b54d1cab7006c0899720aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.001822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-2732e84b-7bd9-4d4a-ae15-0f91bfbdcf10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5be9f84a3b54d1cab7006c0899720aa'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.013939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1409/2812] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:21:43 2022] DELETE /identity/v3/users/a5be9f84a3b54d1cab7006c0899720aa => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:44.190482 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.201550 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27b45c-4a07-46a6-b667-21d3807c4ce7 service swift] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.259781 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.260561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.260848 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.261129 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] PATH_INFO: `/v3/projects/80325ab76d5546bcaa28db2c45cc6515` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.262307 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80325ab76d5546bcaa28db2c45cc6515)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.264278 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.313110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80325ab76d5546bcaa28db2c45cc6515', 'request_id': 'req-98ead50e-110e-40ac-b79c-453574545ac4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.318546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80325ab76d5546bcaa28db2c45cc6515', 'request_id': 'req-98ead50e-110e-40ac-b79c-453574545ac4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.325673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80325ab76d5546bcaa28db2c45cc6515', 'request_id': 'req-98ead50e-110e-40ac-b79c-453574545ac4'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.337016 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] The token cache is being invalidate because project 80325ab76d5546bcaa28db2c45cc6515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:21:44.337311 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.337942 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-98ead50e-110e-40ac-b79c-453574545ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:21:44.339562 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1404/2813] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:21:44 2022] DELETE /identity/v3/projects/80325ab76d5546bcaa28db2c45cc6515 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:21:44.344601 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.344898 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.345179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.363989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:44.365190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:44.425183 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1410/2814] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:44.432908 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.433201 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.433480 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.452874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:44.454352 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:44.468053 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1405/2815] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:44.469416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.479679 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b319fb-2c98-4504-8fa5-52fe84acc464 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.484165 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.484818 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.485096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.485364 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.486074 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:21:44.486374 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.488002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.499253 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1411/2816] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:21:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:21:44.503616 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.512849 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14802f1a-982d-43f4-951f-abb1ae6b1ee4 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.517446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.518677 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.518990 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.519279 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.519962 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.521868 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.546856 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1406/2817] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:21:44 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:44.551458 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.561115 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64fb8-d792-42e3-b518-0dabd178acf5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.617103 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.617811 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.618096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.618373 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.619106 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.621014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.645209 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1412/2818] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:21:44 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:21:44.650256 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.660793 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a0e4f-436f-4073-ba5a-f2c23f5b083f admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.665373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.666030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.666313 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.666610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.667328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.668926 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.679169 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1407/2819] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:44.683006 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.693607 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71507a3e-6527-4fa5-a37f-0da045ccf369 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.698126 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.698941 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.699222 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.699495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.700237 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.701872 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb70d68-205d-433a-b274-8b1edb890b16 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.712172 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1413/2820] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:21:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:21:44.716187 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.726089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbfeead-f9e5-4486-85cb-1cedcd12f9b6 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.730881 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.731761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.732045 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.732320 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] PATH_INFO: `/v3/projects/8db856deb8834218acc26f7af5dfbe00/users/009134b036194923891214978273ac63/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.746840 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db856deb8834218acc26f7af5dfbe00, user_id=009134b036194923891214978273ac63, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.749492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.763458 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1408/2821] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:21:44 2022] PUT /identity/v3/projects/8db856deb8834218acc26f7af5dfbe00/users/009134b036194923891214978273ac63/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:21:44.776221 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941939f-36d0-4ab7-8a7e-2c344d5612a0 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.776517 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941939f-36d0-4ab7-8a7e-2c344d5612a0 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.776803 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941939f-36d0-4ab7-8a7e-2c344d5612a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.805789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6941939f-36d0-4ab7-8a7e-2c344d5612a0 None None] MFA Rules not processed for user `009134b036194923891214978273ac63`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:44.807029 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6941939f-36d0-4ab7-8a7e-2c344d5612a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:44.875777 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1414/2822] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:21:44.886784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:21:44.888530 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:44.945225 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1dd4f-6a2c-4334-96be-0f99eb5cd86d admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:21:44.949531 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:21:44.950176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:44.950455 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:44.950772 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:44.967603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:21:44.967603 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070775e-b0c3-4570-b95e-beabcb20d5f4 service cinder] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:21:44.978638 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1409/2823] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:21:46.326806 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:21:46.327340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:21:46.327340 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:21:46.347844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] MFA Rules not processed for user `009134b036194923891214978273ac63`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:21:46.349031 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:21:46.356188 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1415/2824] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:21:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:03.360814 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e951a9-594c-4d6c-b25f-5356ac67311b None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:03.361324 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e951a9-594c-4d6c-b25f-5356ac67311b None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:03.361454 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e951a9-594c-4d6c-b25f-5356ac67311b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:03.379091 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-98e951a9-594c-4d6c-b25f-5356ac67311b None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:03.380262 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-98e951a9-594c-4d6c-b25f-5356ac67311b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:03.432348 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1410/2825] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:22:03.444830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:03.446212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:03.512036 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8aa6-a120-4f34-a1bf-7e0eaf34da24 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:03.516773 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:03.517405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:03.518405 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:03.518693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:03.526441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:03.528127 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:03.536191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1416/2826] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:22:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:22:04.034673 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396a21-e801-4dbc-bf78-f5bd221cc808 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.035036 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396a21-e801-4dbc-bf78-f5bd221cc808 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.035330 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c396a21-e801-4dbc-bf78-f5bd221cc808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.052802 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-3c396a21-e801-4dbc-bf78-f5bd221cc808 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:04.053993 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-3c396a21-e801-4dbc-bf78-f5bd221cc808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:04.061056 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1411/2827] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:04.073297 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:04.084042 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab95b70-609b-456e-98d5-fc289a04e1ed service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:04.088936 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:04.089571 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.089850 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.090123 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.098745 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:04.100286 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:04.108005 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1417/2828] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:22:04.295128 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10cc2e-5d00-4eee-a997-d6c3afd59003 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.295420 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10cc2e-5d00-4eee-a997-d6c3afd59003 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.295700 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa10cc2e-5d00-4eee-a997-d6c3afd59003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.314355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-aa10cc2e-5d00-4eee-a997-d6c3afd59003 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:04.316543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-aa10cc2e-5d00-4eee-a997-d6c3afd59003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:04.323837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1412/2829] 10.222.0.25 () {58 vars in 1009 bytes} [Tue May 17 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:04.336326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:04.347268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfea3b7-9fdb-4538-b8f5-e5397c1fdc04 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:04.352249 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:04.352885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.353170 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.353446 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.361310 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:04.363441 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:04.371348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1418/2830] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:22:04.677558 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.678031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.678130 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.696049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] MFA Rules not processed for user `ec0be08acb9049439ec2e7d22c616177`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:04.697231 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:04.704340 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1413/2831] 10.222.0.25 () {58 vars in 967 bytes} [Tue May 17 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:04.716164 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:04.726484 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6d31-92bc-419b-9eaf-e4cfd338ac47 service swift] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:04.731702 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ecb9355635e486aa8e5f9e4d38ead62', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:04.732377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:04.732657 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:04.732931 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:04.741436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:04.743021 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ce2e9-7f71-4c8a-b655-eba874a79d18 service swift] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:04.750793 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1419/2832] 10.222.0.25 () {60 vars in 1384 bytes} [Tue May 17 18:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 17 18:22:07.000295 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.060884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a74366-da10-4b5a-b3e2-0de3e8206302 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.065379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.066328 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.066642 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.066924 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] PATH_INFO: `/v3/users/009134b036194923891214978273ac63` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.068430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=009134b036194923891214978273ac63)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.070287 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.113414 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009134b036194923891214978273ac63'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.124855 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009134b036194923891214978273ac63'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.125518 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009134b036194923891214978273ac63'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.132761 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009134b036194923891214978273ac63'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.139832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009134b036194923891214978273ac63'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.146086 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1414/2833] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:22:06 2022] DELETE /identity/v3/users/009134b036194923891214978273ac63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:07.150516 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.151049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.151158 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.167998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:07.169168 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:07.226540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1420/2834] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:07.236142 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.237574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:07.294217 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf45d3-1135-4306-b228-b94eec3c8b6e admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.298010 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.298704 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.298983 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.299258 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.308866 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.310355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c25a3a-731c-4301-8490-002087417968 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.320989 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1415/2835] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:07.490240 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.491698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:07.503823 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a853fee-03c7-4768-9f7a-456ab1dfec94 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.508617 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.509481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.509747 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.510151 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] PATH_INFO: `/v3/projects/8db856deb8834218acc26f7af5dfbe00` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.511391 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db856deb8834218acc26f7af5dfbe00)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.513272 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.558199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db856deb8834218acc26f7af5dfbe00', 'request_id': 'req-5c9841c5-4f97-42bf-9d66-e518e9c92873'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.563417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db856deb8834218acc26f7af5dfbe00', 'request_id': 'req-5c9841c5-4f97-42bf-9d66-e518e9c92873'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.571095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db856deb8834218acc26f7af5dfbe00', 'request_id': 'req-5c9841c5-4f97-42bf-9d66-e518e9c92873'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.582530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] The token cache is being invalidate because project 8db856deb8834218acc26f7af5dfbe00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:22:07.582846 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.583471 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-5c9841c5-4f97-42bf-9d66-e518e9c92873 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:07.584999 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1421/2836] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:22:07 2022] DELETE /identity/v3/projects/8db856deb8834218acc26f7af5dfbe00 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:07.589799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.590082 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.590354 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.608031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:07.609213 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:07.665771 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1416/2837] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:07.673177 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.673461 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.673733 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.691526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:07.692969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:07.700678 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1422/2838] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:07.704680 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.714956 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3715-b4ef-46ee-bb9f-9d55355ef2a5 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.719555 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.720205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.720487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.720759 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.721475 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79968) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:22:07.721784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.724089 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.735172 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1417/2839] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 17 18:22:07.739367 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.748320 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7024e08c-92dd-46c1-84e6-39d71a09544a None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.752874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.753603 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.753882 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.754148 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.754900 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.756757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.782519 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1423/2840] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:22:07 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:07.786804 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.796442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e31a8f-3254-40c0-8634-e2ac15ed4e92 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.852379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.852979 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.853267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.853544 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] PATH_INFO: `/v3/users` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.854238 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.856184 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.875679 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1418/2841] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:22:07 2022] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:07.880379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.890417 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbdb5b-636d-428d-aba3-d5d4130b42a0 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.895651 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.896314 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.896636 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.896919 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.897649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.899298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.909435 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1424/2842] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:07.913546 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.923410 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae27113-de53-4954-976c-2e7ce056df88 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.928085 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.928747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.929030 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.929302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.930015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.931660 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b779e7f0-0c2c-494c-8c19-c62e62bc3067 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.942282 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1419/2843] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:07.947096 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:07.957895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7c498-3a1d-42cf-bce9-4bd5e24acbb2 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:07.962647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:07.963536 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:07.963817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:07.964093 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] PATH_INFO: `/v3/projects/62cba0dd0f7240c48a174b3f53414c90/users/491328c758cf4a419651239510d5efc0/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:07.978766 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62cba0dd0f7240c48a174b3f53414c90, user_id=491328c758cf4a419651239510d5efc0, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:07.981392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:07.994330 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1425/2844] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:22:07 2022] PUT /identity/v3/projects/62cba0dd0f7240c48a174b3f53414c90/users/491328c758cf4a419651239510d5efc0/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:08.004657 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:08.005182 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:08.005302 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:08.032448 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] MFA Rules not processed for user `491328c758cf4a419651239510d5efc0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:08.033670 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:08.095511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1420/2845] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 17 18:22:08.106199 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:08.107847 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:08.163035 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3559c-20f3-4400-bac7-3c66ab1edf65 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:08.166768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:08.167412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:08.167695 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:08.167975 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:08.176114 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:08.177530 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:08.186120 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1426/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:13.484049 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:13.485504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:13.539894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae401dac-033f-416c-ab4f-88903f934103 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:13.543382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:13.544019 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:13.544301 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:13.544574 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:13.546276 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:13.605355 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:13.606795 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e0aed-671f-4a05-b3a4-b4b40adb18a0 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:13.616002 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1421/2847] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:24.284243 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:24.344968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25054c96-3463-439f-ac5f-567201272248 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:24.350027 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:24.350932 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:24.351212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:24.351481 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] PATH_INFO: `/v3/users/491328c758cf4a419651239510d5efc0` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:24.352649 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] RBAC: Authorizing `identity:delete_user(user_id=491328c758cf4a419651239510d5efc0)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:24.354541 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:24.397250 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '491328c758cf4a419651239510d5efc0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.408271 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '491328c758cf4a419651239510d5efc0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.408916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '491328c758cf4a419651239510d5efc0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.409512 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '491328c758cf4a419651239510d5efc0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.416408 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '491328c758cf4a419651239510d5efc0'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.428574 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1427/2848] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:22:24 2022] DELETE /identity/v3/users/491328c758cf4a419651239510d5efc0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:24.433100 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:24.433598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:24.433709 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:24.451416 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:24.452588 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:24.508907 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1422/2849] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:24.518554 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:24.520456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:24.577139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2949d3-3984-40fb-aa01-9597c69f811d admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:24.580768 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:24.581412 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:24.581696 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:24.582659 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:24.591472 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:24.592883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd6887-29f8-47c4-b555-d08e20cb2530 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:24.602179 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1428/2850] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:24.860918 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:24.862626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:24.875387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad232ac-d4aa-4dc6-bb59-531a60302cd8 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:24.880769 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:24.881663 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:24.881948 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:24.882382 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] PATH_INFO: `/v3/projects/62cba0dd0f7240c48a174b3f53414c90` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:24.884305 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=62cba0dd0f7240c48a174b3f53414c90)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:24.886275 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:24.934919 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62cba0dd0f7240c48a174b3f53414c90', 'request_id': 'req-dfefc151-8b12-45e0-b852-9292cbe06cfe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.940270 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62cba0dd0f7240c48a174b3f53414c90', 'request_id': 'req-dfefc151-8b12-45e0-b852-9292cbe06cfe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.948281 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62cba0dd0f7240c48a174b3f53414c90', 'request_id': 'req-dfefc151-8b12-45e0-b852-9292cbe06cfe'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.958850 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] The token cache is being invalidate because project 62cba0dd0f7240c48a174b3f53414c90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:22:24.959133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.959754 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-dfefc151-8b12-45e0-b852-9292cbe06cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:22:24.961285 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1423/2851] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:22:24 2022] DELETE /identity/v3/projects/62cba0dd0f7240c48a174b3f53414c90 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:24.969255 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:24.969564 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:24.969836 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:24.986917 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:24.988879 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:25.045594 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1429/2852] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:25.055252 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.055543 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.055822 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.074331 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:25.075561 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:25.083598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1424/2853] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:25.087621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.097109 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f300d09-9301-40d3-becf-928bb5c7f002 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.102313 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.103007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.103295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.103576 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] PATH_INFO: `/v3/domains` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.104298 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79967) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 17 18:22:25.104605 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.106193 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.118890 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1430/2854] 10.222.0.25 () {58 vars in 1152 bytes} [Tue May 17 18:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 17 18:22:25.123101 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.132000 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41574d-f101-4892-9dd3-06fb7483f4c3 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.136542 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.137207 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.137492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.137791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.138491 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.140437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.165398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1425/2855] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:22:25 2022] POST /identity/v3/projects => generated 377 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:25.169434 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.179817 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fabd8e7-3268-4018-8389-dc8880af0714 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.232674 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.233326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.233606 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.233874 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.234542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.236448 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.255840 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1431/2856] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:22:25 2022] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:25.259922 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.269958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55619e3-7e56-4d41-b1d2-5aa67033e7e5 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.274505 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.275194 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.275500 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.275799 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.276522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.278110 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.288628 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1426/2857] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:25.292327 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.302680 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecaa272-4b67-4bee-bf0b-f7fd293ac44b admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.307092 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.307738 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.308017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.308295 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] PATH_INFO: `/v3/roles` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.309007 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.310585 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d5e58-4f59-436a-af11-78fbea8c743d admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.320528 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1432/2858] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:25.324387 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.334073 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12002d43-80a6-402a-a00c-e911414aa932 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.338749 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.339613 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.339892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.340163 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] PATH_INFO: `/v3/projects/af75981c6f0c44168aa9123430944fd2/users/91d999e39c144d04ac8c6ca5a4660d24/roles/56e6612f0b624b24b14d5d60b68b2ceb` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.354429 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af75981c6f0c44168aa9123430944fd2, user_id=91d999e39c144d04ac8c6ca5a4660d24, role_id=56e6612f0b624b24b14d5d60b68b2ceb)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.357074 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.369624 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1427/2859] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:22:25 2022] PUT /identity/v3/projects/af75981c6f0c44168aa9123430944fd2/users/91d999e39c144d04ac8c6ca5a4660d24/roles/56e6612f0b624b24b14d5d60b68b2ceb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:25.374552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd85-781c-4c60-8dd3-20d27855df9b None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.374863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd85-781c-4c60-8dd3-20d27855df9b None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.375135 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aefd85-781c-4c60-8dd3-20d27855df9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.392145 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-83aefd85-781c-4c60-8dd3-20d27855df9b None None] MFA Rules not processed for user `019f8abbfcaf48d98532c6915b54e5c0`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:25.393315 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-83aefd85-781c-4c60-8dd3-20d27855df9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:25.451019 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1433/2860] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:25.461035 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:25.462747 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:25.516200 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce79c5c-9a91-4f1f-a4ef-8d82f97b77a4 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:25.520257 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:25.520891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:25.521170 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:25.521438 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:25.531133 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:25.532551 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:25.542120 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1428/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:29.367753 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.368260 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.368377 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.395515 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.auth.core [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] MFA Rules not processed for user `91d999e39c144d04ac8c6ca5a4660d24`. Rule list: `[]` (Enabled: `True`). {{(pid=79967) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:29.396621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:29.460568 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1434/2862] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:29.465106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.475837 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2ecb2a-18a5-4141-950c-efd9ed503687 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.480592 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.481268 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.481554 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.481832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] PATH_INFO: `/v3/projects` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.482534 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.484532 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.512882 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1429/2863] 10.222.0.25 () {60 vars in 1152 bytes} [Tue May 17 18:22:29 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:29.517049 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.528187 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11662fef-109c-4e71-b765-e7aed46b66a6 None None] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.588124 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.588807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] REQUEST_METHOD: `POST` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.589095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.589376 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] PATH_INFO: `/v3/users` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.590069 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.592014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.617977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1435/2864] 10.222.0.25 () {60 vars in 1143 bytes} [Tue May 17 18:22:29 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 17 18:22:29.619167 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.629830 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38218255-2ea8-4dcf-8d5f-717d6a0b9855 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.634627 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.635274 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.635559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.635838 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.636891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.638164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.651839 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1430/2865] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:29.656359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.677070 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d53f7-a6fd-4201-ba85-73402d1e1541 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.681754 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.682687 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.682969 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.683268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] PATH_INFO: `/v3/projects/c03fe052d3694398a21da95e62798cab/users/dc173fe6d4cf438ca41f25ec6eab88b2/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.701711 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03fe052d3694398a21da95e62798cab, user_id=dc173fe6d4cf438ca41f25ec6eab88b2, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.704532 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.718939 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1436/2866] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:22:29 2022] PUT /identity/v3/projects/c03fe052d3694398a21da95e62798cab/users/dc173fe6d4cf438ca41f25ec6eab88b2/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:22:29.723439 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.733864 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aab585-347f-4f03-9615-1f6811952324 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.792860 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.793633 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.793982 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.794263 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] PATH_INFO: `/v3/roles` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.795026 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.796626 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2d2c7-7331-4f12-b1f8-34b6d55f3718 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.807176 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1431/2867] 10.222.0.25 () {58 vars in 1121 bytes} [Tue May 17 18:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 17 18:22:29.811375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:29.822971 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63a5d6-5909-478a-8cc3-232a8e013862 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:29.827895 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:29.828794 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:29.829076 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:29.829348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] PATH_INFO: `/v3/projects/c03fe052d3694398a21da95e62798cab/users/dc173fe6d4cf438ca41f25ec6eab88b2/roles/ff3f28a3c0be4c1ea32f186131664150` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:29.831375 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c03fe052d3694398a21da95e62798cab, user_id=dc173fe6d4cf438ca41f25ec6eab88b2, role_id=ff3f28a3c0be4c1ea32f186131664150)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:29.834856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:29.845856 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1437/2868] 10.222.0.25 () {60 vars in 1482 bytes} [Tue May 17 18:22:29 2022] PUT /identity/v3/projects/c03fe052d3694398a21da95e62798cab/users/dc173fe6d4cf438ca41f25ec6eab88b2/roles/ff3f28a3c0be4c1ea32f186131664150 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:22:34.188937 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516b38-ed47-4d7b-a803-5b739b574b59 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:34.189528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516b38-ed47-4d7b-a803-5b739b574b59 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:34.189528 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55516b38-ed47-4d7b-a803-5b739b574b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:34.218446 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-55516b38-ed47-4d7b-a803-5b739b574b59 None None] MFA Rules not processed for user `dc173fe6d4cf438ca41f25ec6eab88b2`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:34.219635 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-55516b38-ed47-4d7b-a803-5b739b574b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:34.288643 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1432/2869] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:34 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:34.302675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:34.304378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:34.382139 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1f3553-d1df-4c12-862b-7f3eb1852ea7 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:34.387688 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:34.388345 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:34.388627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:34.388907 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:34.445759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:34.447372 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:34.457388 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1438/2870] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:50.908529 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:50.909064 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:50.909190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:50.927470 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] MFA Rules not processed for user `91d999e39c144d04ac8c6ca5a4660d24`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:22:50.929203 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:50.936175 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1433/2871] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:22:50.971789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:50.973198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:51.027844 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993738da-e22c-4491-be9d-fd3a48faf63d service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:51.031563 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0292f8e2e5ff4fe8939c078d01993ea1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:51.032212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:51.032499 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:51.032778 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:51.034552 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:51.048721 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:51.050134 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:51.061385 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1439/2872] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:22:57.717784 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:22:57.770788 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0debc6c0-9439-46fd-a44f-be4640932420 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:22:57.775481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:22:57.776134 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:22:57.776417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:22:57.776695 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:22:57.778437 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:22:57.793667 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:22:57.795159 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:22:57.806220 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1434/2873] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:22:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:07.415577 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:07.416979 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:07.428432 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a56cb9-d930-4f79-aec3-353a0e7d2376 service cinder] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:07.431993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:07.432634 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:07.432916 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:07.433191 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:07.441889 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:07.443822 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:07.453201 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1440/2874] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:23:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:23:53.869137 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:23:53.877767 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71366c-05e8-4133-97bf-73d264b56738 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:23:53.881874 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:23:53.882504 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:23:53.882826 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:23:53.883098 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:23:53.884818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:23:53.893927 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:23:53.895938 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:23:53.903713 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1435/2875] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:23:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:24:26.768826 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:24:26.778302 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7492e7-cd13-4415-90bc-167e361368ad service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:24:26.781920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:24:26.782559 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:24:26.782992 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:24:26.783268 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:24:26.785004 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:26.795288 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:24:26.796705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:24:26.805052 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1441/2876] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:24:26.884648 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:24:26.893492 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f20ba-b18c-4dff-aa42-3774b6de432a service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:24:26.898299 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:24:26.898973 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:24:26.899254 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:24:26.899525 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:24:26.901268 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:26.915487 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:24:26.916920 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:24:26.928031 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1436/2877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:24:26.988348 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:24:26.989718 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:27.055885 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18769fa6-68eb-462c-8b5e-8d90663ab2c3 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:24:27.060816 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:24:27.061455 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:24:27.061761 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:24:27.062038 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:24:27.063757 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:27.075366 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:24:27.076938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:24:27.087494 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1442/2878] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:24:27.323215 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:24:27.336610 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96521b56-6499-4b4e-a737-b131c63317f1 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:24:27.342303 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:24:27.343223 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:24:27.343524 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:24:27.343789 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:24:27.345568 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:24:27.359293 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:24:27.360887 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fd23b-9a6f-43b8-9d56-64ed5898bee3 service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:24:27.373417 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1437/2879] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:08.430700 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:08.432553 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:08.503356 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b68f68-cfa5-49b9-9a17-da0376372cd9 service placement] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:08.510318 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:08.511048 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:08.511352 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:08.511901 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:08.513873 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:08.527988 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:08.529588 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:08.542175 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1443/2880] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:25:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:09.200384 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:09.200958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:09.200958 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:09.220831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] MFA Rules not processed for user `91d999e39c144d04ac8c6ca5a4660d24`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:25:09.222791 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:09.229935 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1438/2881] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:25:09.550017 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:09.568830 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef033f-1b64-4531-9b3f-94a4ad626a07 service nova] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:09.573054 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:09.573698 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:09.573977 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:09.574248 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:09.576022 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:09.600198 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:09.602414 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:09.611425 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1444/2882] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:25:27.185373 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:25:27.204674 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628f54c-0fb1-4748-bbfc-65aef45db796 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:25:27.210066 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bc19fa7285245d8bdb984da94d502b8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:25:27.210818 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:25:27.211242 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:25:27.211514 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:25:27.213280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:25:27.226737 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:25:27.228363 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:25:27.239188 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1439/2883] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:25:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 17 18:26:01.239989 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:01.241547 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:01.278113 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57fcfb0-ac47-4d90-af2a-cfc41b8ced4d service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:01.283174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:01.283839 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:01.284118 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:01.284392 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:01.286190 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:01.297774 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:01.299456 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:01.310938 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1445/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:26:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:26:08.162038 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:08.164829 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:08.265676 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2f562-c969-418f-9223-70fc400d450b service nova] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:08.270210 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:08.271113 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:08.271398 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:08.271675 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] PATH_INFO: `/v3/users/240c3f3cc9e943a883e08e6c096edc51` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:08.272847 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=240c3f3cc9e943a883e08e6c096edc51)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:08.274832 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:08.317164 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '240c3f3cc9e943a883e08e6c096edc51'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.328731 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '240c3f3cc9e943a883e08e6c096edc51'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.329442 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '240c3f3cc9e943a883e08e6c096edc51'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.336280 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '240c3f3cc9e943a883e08e6c096edc51'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.343738 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '240c3f3cc9e943a883e08e6c096edc51'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.349686 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1440/2885] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:26:08 2022] DELETE /identity/v3/users/240c3f3cc9e943a883e08e6c096edc51 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:08.523997 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:08.534637 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257e627-fec4-466b-a525-d7b033105573 service placement] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:08.592416 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:08.593323 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:08.593604 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:08.593884 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] PATH_INFO: `/v3/projects/43c948c388ed4ad7bd63255d5c643e11` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:08.595197 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c948c388ed4ad7bd63255d5c643e11)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:08.597149 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:08.640810 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c948c388ed4ad7bd63255d5c643e11', 'request_id': 'req-b6ab288b-0abb-42b1-91b9-cf4580275ff5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.645935 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c948c388ed4ad7bd63255d5c643e11', 'request_id': 'req-b6ab288b-0abb-42b1-91b9-cf4580275ff5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.652759 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c948c388ed4ad7bd63255d5c643e11', 'request_id': 'req-b6ab288b-0abb-42b1-91b9-cf4580275ff5'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.663943 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] The token cache is being invalidate because project 43c948c388ed4ad7bd63255d5c643e11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:08.664974 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.665789 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.667362 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1446/2886] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:26:08 2022] DELETE /identity/v3/projects/43c948c388ed4ad7bd63255d5c643e11 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:26:08.671341 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:08.672724 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:08.685465 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfad140-31e7-4145-b3a6-a30c88691543 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:08.740081 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:08.741007 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:08.741323 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:08.741604 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] PATH_INFO: `/v3/users/eead850a5fb94eb5b68f20e81117eb0e` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:08.743001 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] RBAC: Authorizing `identity:delete_user(user_id=eead850a5fb94eb5b68f20e81117eb0e)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:08.744953 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:08.788314 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eead850a5fb94eb5b68f20e81117eb0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.799413 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eead850a5fb94eb5b68f20e81117eb0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.800061 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eead850a5fb94eb5b68f20e81117eb0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.806691 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eead850a5fb94eb5b68f20e81117eb0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.814366 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-7ea8ea40-db72-425d-83f8-30a130ed586d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eead850a5fb94eb5b68f20e81117eb0e'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:08.820865 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1441/2887] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:26:08 2022] DELETE /identity/v3/users/eead850a5fb94eb5b68f20e81117eb0e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 17 18:26:08.995303 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:26:08.997633 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:26:09.013675 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab288b-0abb-42b1-91b9-cf4580275ff5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:26:09.073326 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:26:09.074207 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:26:09.074495 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:26:09.074807 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] PATH_INFO: `/v3/projects/19b8064243064c04a61f593cc7927944` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:26:09.075998 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b8064243064c04a61f593cc7927944)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:26:09.077892 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:26:09.124464 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b8064243064c04a61f593cc7927944', 'request_id': 'req-4e0bb817-caf1-42a2-8867-3943677b21d8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:09.129707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b8064243064c04a61f593cc7927944', 'request_id': 'req-4e0bb817-caf1-42a2-8867-3943677b21d8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:09.138868 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b8064243064c04a61f593cc7927944', 'request_id': 'req-4e0bb817-caf1-42a2-8867-3943677b21d8'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:09.150382 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] The token cache is being invalidate because project 19b8064243064c04a61f593cc7927944 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79967) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:26:09.150705 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:09.151343 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:26:09.152893 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1447/2888] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:26:08 2022] DELETE /identity/v3/projects/19b8064243064c04a61f593cc7927944 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:27:02.097364 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] REQUEST_METHOD: `POST` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:02.097909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:02.097909 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:02.114940 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.auth.core [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] MFA Rules not processed for user `91d999e39c144d04ac8c6ca5a4660d24`. Rule list: `[]` (Enabled: `True`). {{(pid=79968) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 17 18:27:02.116118 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:02.169389 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1442/2889] 10.222.0.25 () {58 vars in 957 bytes} [Tue May 17 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 17 18:27:02.478287 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:27:02.479968 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:02.539379 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0bb817-caf1-42a2-8867-3943677b21d8 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:27:02.542981 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:27:02.544200 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:27:02.544483 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:27:02.544756 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:27:02.546540 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:27:02.555891 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:27:02.557300 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:27:02.565319 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1448/2890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:27:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:48.039115 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:48.050121 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed19b6e-41b3-43db-82ef-ce96c9b28f00 None None] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:48.053595 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:48.054240 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:48.054522 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:48.054831 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:48.056580 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:48.067696 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:48.069122 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:48.077981 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1443/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:28:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:49.063731 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:49.072991 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5d3951-be18-455d-89f5-eec845a26013 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:49.076845 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:49.077505 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:49.077790 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:49.078066 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:49.079920 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:49.171276 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:49.172693 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:49.193595 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1449/2892] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:28:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:50.367607 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:50.376511 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d86443-b9a9-4a83-8d05-b34a035512ec service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:50.380379 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:50.381023 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:50.381430 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:50.381714 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:50.383563 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:50.406515 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:50.407985 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:50.419891 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1444/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:28:55.757266 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:28:55.759098 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:55.770609 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912826-04fc-48a8-81bc-562f848beb83 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:28:55.774263 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:28:55.775013 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:28:55.775212 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:28:55.775491 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:28:55.777290 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:28:55.788401 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:28:55.789837 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:28:55.810927 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1450/2894] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:28:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:01.114190 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:01.123015 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d97dc-c54f-45a9-8f06-ab0107a4132c service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:01.127806 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4fbd6d1978f41e1af28e18d26395767', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:01.128219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] REQUEST_METHOD: `GET` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:01.128503 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:01.128805 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:01.130559 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:01.192819 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:01.194259 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:01.203863 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1445/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:29:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 17 18:29:07.269676 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.271002 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:07.289621 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ca134-1a8a-4d20-9b2c-7182221708d1 service neutron] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.295361 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.296225 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.296503 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.297403 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] PATH_INFO: `/v3/users/91d999e39c144d04ac8c6ca5a4660d24` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.297963 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d999e39c144d04ac8c6ca5a4660d24)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.300359 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.351378 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d999e39c144d04ac8c6ca5a4660d24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.363014 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d999e39c144d04ac8c6ca5a4660d24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.363707 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d999e39c144d04ac8c6ca5a4660d24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.364332 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d999e39c144d04ac8c6ca5a4660d24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.372227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d999e39c144d04ac8c6ca5a4660d24'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.388526 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1451/2896] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:29:07 2022] DELETE /identity/v3/users/91d999e39c144d04ac8c6ca5a4660d24 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:07.561892 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.572636 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560e7eb-9f93-4db2-8818-73095f3a7af8 service neutron] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.628205 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.629094 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.629395 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.629718 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] PATH_INFO: `/v3/projects/af75981c6f0c44168aa9123430944fd2` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.630921 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af75981c6f0c44168aa9123430944fd2)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.632843 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.677020 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af75981c6f0c44168aa9123430944fd2', 'request_id': 'req-232214f2-de6b-47d1-b85f-663aea2794a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.682112 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af75981c6f0c44168aa9123430944fd2', 'request_id': 'req-232214f2-de6b-47d1-b85f-663aea2794a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.688827 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af75981c6f0c44168aa9123430944fd2', 'request_id': 'req-232214f2-de6b-47d1-b85f-663aea2794a3'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.699766 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] The token cache is being invalidate because project af75981c6f0c44168aa9123430944fd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:07.700054 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.700726 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.702300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1446/2897] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:29:07 2022] DELETE /identity/v3/projects/af75981c6f0c44168aa9123430944fd2 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:07.706857 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:07.708227 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:07.721775 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f916f-b712-41c1-82ba-bcbfa3a39789 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:07.776095 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:07.776880 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:07.777161 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:07.777436 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] PATH_INFO: `/v3/users/dc173fe6d4cf438ca41f25ec6eab88b2` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:07.778647 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc173fe6d4cf438ca41f25ec6eab88b2)` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:07.780545 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:07.825993 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc173fe6d4cf438ca41f25ec6eab88b2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.838104 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc173fe6d4cf438ca41f25ec6eab88b2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.838825 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc173fe6d4cf438ca41f25ec6eab88b2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.839418 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc173fe6d4cf438ca41f25ec6eab88b2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.846513 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.notifications [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc173fe6d4cf438ca41f25ec6eab88b2'} {{(pid=79967) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:07.858142 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1452/2898] 10.222.0.25 () {58 vars in 1223 bytes} [Tue May 17 18:29:07 2022] DELETE /identity/v3/users/dc173fe6d4cf438ca41f25ec6eab88b2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:29:08.029211 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Authenticating user token {{(pid=79968) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:29:08.030884 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.fernet_utils [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79968) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:29:08.044481 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232214f2-de6b-47d1-b85f-663aea2794a3 admin admin] Validating token access rules against request {{(pid=79968) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:29:08.100106 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '019f8abbfcaf48d98532c6915b54e5c0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce77dde206fe428ba1cf2d3583c7c4a2', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79968) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:29:08.100963 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:29:08.101326 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:29:08.101598 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] PATH_INFO: `/v3/projects/c03fe052d3694398a21da95e62798cab` {{(pid=79968) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:29:08.102796 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c03fe052d3694398a21da95e62798cab)` {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:29:08.104690 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] RBAC: Authorization granted {{(pid=79968) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:29:08.148300 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c03fe052d3694398a21da95e62798cab', 'request_id': 'req-972541e8-ce43-47de-ad30-78cd2e7fc2ac'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:08.153649 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c03fe052d3694398a21da95e62798cab', 'request_id': 'req-972541e8-ce43-47de-ad30-78cd2e7fc2ac'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:08.161219 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c03fe052d3694398a21da95e62798cab', 'request_id': 'req-972541e8-ce43-47de-ad30-78cd2e7fc2ac'} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:08.171925 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] The token cache is being invalidate because project c03fe052d3694398a21da95e62798cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79968) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 17 18:29:08.172267 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:08.172894 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: DEBUG keystone.notifications [None req-972541e8-ce43-47de-ad30-78cd2e7fc2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79968) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 17 18:29:08.175298 dv-cinder-841302-3-iscsi devstack@keystone.service[79968]: [pid: 79968|app: 0|req: 1447/2899] 10.222.0.25 () {58 vars in 1232 bytes} [Tue May 17 18:29:08 2022] DELETE /identity/v3/projects/c03fe052d3694398a21da95e62798cab => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 17 18:31:52.079254 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Authenticating user token {{(pid=79967) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 17 18:31:52.080627 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:52.148883 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca5dfc-9c3a-44a0-98c7-a70b6ec0eaf5 admin admin] Validating token access rules against request {{(pid=79967) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 17 18:31:52.207863 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b07f105e72884b37a1e9a9bed0415466', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cfd3bc2d0bfb46e59ea433d541abcaf9', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79967) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 17 18:31:52.208542 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] REQUEST_METHOD: `GET` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 17 18:31:52.208848 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] SCRIPT_NAME: `/identity` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 17 18:31:52.209125 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79967) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 17 18:31:52.211174 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.fernet_utils [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79967) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 17 18:31:52.222046 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 17 18:31:52.223624 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e37533-d313-4429-b6aa-e9020ae86618 service placement] RBAC: Authorization granted {{(pid=79967) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 17 18:31:52.233342 dv-cinder-841302-3-iscsi devstack@keystone.service[79967]: [pid: 79967|app: 0|req: 1453/2900] 10.222.0.25 () {60 vars in 1365 bytes} [Tue May 17 18:31:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)